-- Logs begin at Tue 2022-09-27 03:40:37 UTC, end at Tue 2022-09-27 04:41:32 UTC. -- Sep 27 04:11:44.891765 dv-cinder-859186-3-iscsi systemd[1]: Started Devstack devstack@q-agt.service. Sep 27 04:11:47.442364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.common.config [-] Logging enabled! Sep 27 04:11:47.442936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.common.config [-] /usr/local/bin/neutron-openvswitch-agent version 21.1.0.dev25 Sep 27 04:11:47.443146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-openvswitch-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=107232) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} Sep 27 04:11:47.443598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO os_ken.base.app_manager [-] loading app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp Sep 27 04:11:47.928937 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO keyring.backend [-] Loading KWallet Sep 27 04:11:47.936804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO keyring.backend [-] Loading SecretService Sep 27 04:11:47.940481 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO keyring.backend [-] Loading Windows Sep 27 04:11:47.941881 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO keyring.backend [-] Loading chainer Sep 27 04:11:47.942611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO keyring.backend [-] Loading macOS Sep 27 04:11:48.560803 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.561380 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.561380 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.562594 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.562875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.563143 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.615391 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.616287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.616501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.626459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.626788 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.626969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.650431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.650724 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.650993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.689410 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.689581 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.690029 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.863936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Sep 27 04:11:48.864967 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO os_ken.base.app_manager [-] loading app os_ken.app.ofctl.service Sep 27 04:11:48.866000 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Sep 27 04:11:48.866472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO os_ken.base.app_manager [-] instantiating app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp of OVSNeutronAgentOSKenApp Sep 27 04:11:48.866930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO os_ken.base.app_manager [-] instantiating app os_ken.controller.ofp_handler of OFPHandler Sep 27 04:11:48.867352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO os_ken.base.app_manager [-] instantiating app os_ken.app.ofctl.service of OfctlService Sep 27 04:11:48.868592 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: Open vSwitch agent after_init 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:48.870929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.agent_extensions_manager [-] Loaded agent extensions: [] Sep 27 04:11:48.871225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 04:11:48.871419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Configuration options gathered from: {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 04:11:48.871635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 04:11:48.871924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 04:11:48.872115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ================================================================================ {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 04:11:48.872405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent_down_time = 75 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.872665 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] allow_bulk = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.872930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_extensions_path = {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.873195 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_paste_config = api-paste.ini {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.873456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] auth_strategy = keystone {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.873709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] backlog = 4096 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.873999 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] base_mac = fa:16:3e:00:00:00 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.874277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_host = 0.0.0.0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.874530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_port = 9696 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.874779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] client_socket_timeout = 900 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.875033 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_dir = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.875230 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.875479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_source = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.875736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] control_exchange = neutron {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.875991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] core_plugin = ml2 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.876242 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] debug = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.876486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_availability_zones = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.876879 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.877252 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_agent_notification = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.877503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_lease_duration = 86400 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.877780 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_load_type = networks {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.878047 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dns_domain = openstacklocal {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.878293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_new_agents = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.878536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_traditional_dhcp = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.878775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] external_dns_driver = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.879017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] filter_validation = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.879269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] global_physnet_mtu = 1500 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.879579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] host = dv-cinder-859186-3-iscsi {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.879822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] http_retries = 3 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.880077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_format = [instance: %(uuid)s] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.880330 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.880576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipam_driver = internal {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.880861 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipv6_pd_enabled = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.881060 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_config_append = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.881347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.881591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_dir = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.881855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_file = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.882097 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval = 1 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.882353 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval_type = days {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.882605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotation_type = none {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.882859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.883046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.883234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.883487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.883741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.883983 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_dns_nameservers = 5 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.884227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_header_line = 16384 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.884465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_count = 30 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.884702 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_size_mb = 200 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.884940 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_subnet_host_routes = 20 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.885176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] network_link_prefix = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.885422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_data_changes = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.885672 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_status_changes = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.885945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] pagination_max_limit = -1 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.886186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] publish_errors = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.886427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_burst = 0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.886942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_except_level = CRITICAL {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.887186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_interval = 0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.887437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] retry_until_window = 30 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.887669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_resources_processing_step = 20 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.887909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_response_max_timeout = 600 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.888153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] send_events_interval = 2 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.888419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.888668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] setproctitle = on {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.888918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] state_path = /opt/stack/data/neutron {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.889168 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] syslog_log_facility = LOG_USER {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.889406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] tcp_keepidle = 600 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.889654 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] transport_url = **** {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.889916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_eventlog = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.890155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_journal = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.890392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_json = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.890630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_ssl = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.890868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_stderr = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.891115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_syslog = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.891352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] vlan_transparent = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.891586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] watch_log_file = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.891826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_default_pool_size = 100 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.892064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_keep_alive = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.892314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.892553 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_server_debug = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:11:48.892817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.disable_process_locking = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.893081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.893349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.connection_string = messaging:// {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.893603 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.enabled = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.893883 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_doc_type = notification {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.894133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_size = 10000 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.894388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_time = 2m {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.894636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.filter_error_trace = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.894890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.hmac_keys = SECRET_KEY {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.895145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.sentinel_service_name = mymaster {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.895406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.socket_timeout = 0.1 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.895650 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.trace_sqlalchemy = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.895915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_new_defaults = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.896172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_scope = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.896435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_default_rule = default {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.896714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.897503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.897777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.898026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.898267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.898510 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.898760 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.899016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.899264 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.899524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.899778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.900020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.900450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.900863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.arp_responder = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.901273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.baremetal_smartnic = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.901683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dont_fragment = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.902112 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.drop_flows_on_start = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.902524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.902920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp_inherit = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.903316 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.enable_distributed_routing = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.903725 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.explicitly_egress_direct = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.904120 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.l2_population = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.904514 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.log_agent_heartbeats = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.904907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.minimize_polling = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.905312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.ovsdb_monitor_respawn_interval = 30 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.905706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.polling_interval = 2 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.906133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.quitting_rpc_timeout = 10 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.906549 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.report_interval = 30.0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.906956 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.907371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.907763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_csum = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.908180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_types = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.908578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.use_helper_for_ns_read = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.908984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.veth_mtu = 9000 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.909379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.vxlan_udp_port = 4789 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.909834 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mac_table_size = 50000 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.910249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mappings = ['physnet1:br-data'] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.910674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.datapath_type = system {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.911070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.igmp_snooping_enable = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.911486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.int_peer_patch_port = patch-tun {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.911908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.integration_bridge = br-int {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.912302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.local_ip = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.913262 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_connect_timeout = 300 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.913670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_inactivity_probe = 10 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.914117 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_address = 127.0.0.1 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.914523 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_port = 6633 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.914918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_request_timeout = 300 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.915325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.openflow_processed_per_port = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.915750 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.916154 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_debug = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.916564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_timeout = 10 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.916971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_bandwidths = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.917363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_default_hypervisor = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.917808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_hypervisors = {} {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.918248 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.918708 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.919110 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.919509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.919913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_ca_cert_file = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.920303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_cert_file = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.920694 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_key_file = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.921097 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tun_peer_patch_port = patch-int {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.921501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tunnel_bridge = br-tun {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.921927 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.922345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_rebinding_time = 0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.922739 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_renewal_time = 0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.923130 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.enable_ipv6 = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.923527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] LOCAL_IP.static_nat = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.923926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_section = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.924345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_type = password {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.924749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.925136 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.certfile = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.925530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.collect_timing = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.925980 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.endpoint_type = public {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.926373 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.insecure = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.926778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.keyfile = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.927181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.region_name = RegionOne {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.927573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.split_loggers = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.927961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.timeout = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.928382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_section = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.928809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_type = password {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.929214 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.929602 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.certfile = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.930018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.collect_timing = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.930439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.endpoint_type = public {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.930833 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.insecure = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.931234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.keyfile = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.931682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.region_name = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.932073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.split_loggers = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.932461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.timeout = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.932859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_section = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.933266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_type = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.933663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.cafile = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.934090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.certfile = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.934483 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.collect_timing = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.934869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retries = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.935254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retry_delay = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.935666 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.enable_notifications = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.936043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.endpoint_override = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.936434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.insecure = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.936821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.interface = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.937218 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.keyfile = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.937618 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.max_version = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.938034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.min_version = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.938423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.region_name = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.938817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_name = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.939204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_type = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.939664 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.split_loggers = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.940073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retries = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.940462 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retry_delay = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.940849 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.timeout = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.941234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.valid_interfaces = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.941621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.version = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.942047 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] cli_script.dry_run = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.942479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.942872 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.943268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.943680 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.944142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.944552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.944945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.945341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.945737 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.946149 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.946572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.946972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.947372 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.947782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.948175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.948592 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.949000 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.949408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.949836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.950234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.950642 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.951090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.951481 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.951872 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.952269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.952666 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.953086 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.953491 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.953914 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.954337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.954741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_version = {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.955160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.driver = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.955568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.retry = -1 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.956002 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.956395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.transport_url = **** {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.956805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.957195 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.group = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.957602 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.helper_command = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.958030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.logger_name = oslo_privsep.daemon {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.958424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.thread_pool_size = 4 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.958814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.user = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.959232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.960148 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.group = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.960548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.helper_command = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.960946 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.961340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.961724 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.user = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.962142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.962546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.group = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.962931 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.helper_command = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.963327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.963730 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.964113 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.user = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.964521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.capabilities = [21] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.964924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.group = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.965310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.helper_command = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.965707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.966133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.thread_pool_size = 4 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.966520 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.user = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.967006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.capabilities = [12] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.967391 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.group = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.967777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.helper_command = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.968174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.968565 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.thread_pool_size = 4 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.968959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.user = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.969375 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.capabilities = [12, 21] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.969790 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.group = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.970175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.helper_command = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.970573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.970963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.thread_pool_size = 4 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.971363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.user = None {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.971760 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_providers.service_provider = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.972157 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.972499 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent.extensions = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.972901 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.default_quota = -1 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.973307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.973726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_network = 100 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.974151 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_port = 500 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.974546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_rbac_policy = 10 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.975027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group = 100 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.975920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group_rule = 100 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.976345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_subnet = 100 {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.976739 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.track_quota_usage = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.977150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_ipset = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.977574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_security_group = True {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.978008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.978405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:11:48.978747 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=107232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 04:11:49.030953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Flow_Table.name {{(pid=107232) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Sep 27 04:11:49.031441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Mirror.name {{(pid=107232) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Sep 27 04:11:49.031805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Bridge.name {{(pid=107232) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 27 04:11:49.032172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port.name {{(pid=107232) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 27 04:11:49.032548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Interface.name {{(pid=107232) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 27 04:11:49.032913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Manager.target {{(pid=107232) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 27 04:11:49.102304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-int, may_exist=True, datapath_type=system) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:49.102907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow13', 'OpenFlow14', 'OpenFlow10')) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:49.103787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:49.115793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-int, mode=secure) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:49.121196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-int. {{(pid=107232) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Sep 27 04:11:49.121788 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-int, targets=['tcp:127.0.0.1:6633']) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:50.141700 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=e64dfa93-e996-4d88-88bf-d4045bcf2177, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:50.147911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=e64dfa93-e996-4d88-88bf-d4045bcf2177, col_values=(('inactivity_probe', 10000),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:50.154445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Bridge, record=br-int, col_values=(('mcast_snooping_enable', False),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:50.157220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mcast-snooping-disable-flood-unregistered': 'false'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:50.172020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-int has datapath-ID 00002ac10c84cd43 Sep 27 04:11:50.175684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0xc3dab77f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=23) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:50.177784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xc3dab781,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:50.180321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xc3dab783,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=59) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:50.187265 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xc3dab785,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=60) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:50.192312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0xc3dab787,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=24) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:50.198779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xc3dab789,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'vlan_vid': 8191}),out_group=0,out_port=0,priority=65535,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:50.201438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xc3dab78b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=62) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:50.206375 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xc3dab78d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=30) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:50.211350 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xc3dab78f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=31) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:50.211902 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.utils [-] Std library socket module is patched by eventlet. Requesting std library socket module from eventlet. {{(pid=107232) __init__ /opt/stack/neutron/neutron/agent/common/utils.py:91}} Sep 27 04:11:50.212744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Mapping physical network physnet1 to bridge br-data Sep 27 04:11:50.213848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Bridge br-data datapath-id = 0x00009e7508e13a40 Sep 27 04:11:50.214700 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-data, may_exist=True, datapath_type=system) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:50.215211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-data, column=protocols, values=('OpenFlow13', 'OpenFlow14', 'OpenFlow10')) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:50.215786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-data, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:50.223485 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-data, mode=secure) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:50.231083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-data. {{(pid=107232) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Sep 27 04:11:50.231339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-data, targets=['tcp:127.0.0.1:6633']) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:51.243762 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=1d7b3571-cbbc-4140-96b6-8a6a92bc6a1c, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:51.254153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=1d7b3571-cbbc-4140-96b6-8a6a92bc6a1c, col_values=(('inactivity_probe', 10000),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:51.268339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-data has datapath-ID 00009e7508e13a40 Sep 27 04:11:51.274293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0x6ec32e8f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:51.277382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-int, port=int-br-data, may_exist=True) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:51.278339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=int-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:51.297332 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=int-br-data, col_values=(('other_config', {'mcast-snooping-flood-reports': 'False', 'mcast-snooping-flood': 'False'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:51.307539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-data, port=phy-br-data, may_exist=True) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:51.308464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:51.321736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xc3dab791,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:51.324099 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x6ec32e91,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:51.324935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=int-br-data, col_values=(('options', {'peer': 'phy-br-data'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:51.334053 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('options', {'peer': 'int-br-data'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:51.344389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Port {{(pid=107232) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 27 04:11:51.349352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroup {{(pid=107232) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 27 04:11:51.351019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroupRule {{(pid=107232) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 27 04:11:51.352100 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Network {{(pid=107232) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 27 04:11:51.353268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Subnet {{(pid=107232) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 27 04:11:51.354299 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for AddressGroup {{(pid=107232) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 27 04:11:51.527868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:51.528122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:51.528558 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:51.528934 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:51.529324 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:51.529883 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:51.591417 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Init firewall settings (driver=openvswitch) {{(pid=107232) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:121}} Sep 27 04:11:51.592965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow11', 'OpenFlow12')) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:11:52.616722 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2297b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:52.619821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2297d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:52.622352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2297f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:52.624950 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22981,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:52.627334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22983,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:52.628111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.ip_conntrack [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Starting ip_conntrack _process_queue_worker() threads {{(pid=107232) _start_process_queue /opt/stack/neutron/neutron/agent/linux/ip_conntrack.py:80}} Sep 27 04:11:52.628814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Processing 1 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:11:52.630270 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmp4bcuviul/privsep.sock'] Sep 27 04:11:52.649815 dv-cinder-859186-3-iscsi sudo[108920]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmp4bcuviul/privsep.sock Sep 27 04:11:52.652364 dv-cinder-859186-3-iscsi sudo[108920]: pam_unix(sudo:session): session opened for user root by (uid=0) Sep 27 04:11:54.014215 dv-cinder-859186-3-iscsi sudo[108920]: pam_unix(sudo:session): session closed for user root Sep 27 04:11:54.016422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Spawned new privsep daemon via rootwrap Sep 27 04:11:54.016999 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Accepted privsep connection to /tmp/tmp4bcuviul/privsep.sock {{(pid=107232) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Sep 27 04:11:54.018245 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 27 04:11:54.018497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 27 04:11:54.018746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/none Sep 27 04:11:54.018983 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 108929 Sep 27 04:11:54.021804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[181c7b4c-2388-406c-8381-31b32b2b10c4]: (2,) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.624987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=108929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 04:11:54.625663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.000s {{(pid=108929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 04:11:54.626194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.000s {{(pid=108929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 04:11:54.858402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[163aa2a7-d7fa-4d07-ba27-21bc11b7703e]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.859266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Processing 1 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:11:54.869587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ed01df-644b-4d0b-9255-da2fd12fdbd5]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.870406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Processing 1 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:11:54.881805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3853daad-dabf-4646-bb34-a32035a1d061]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.882311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Processing 1 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:11:54.892770 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bde561-4a2a-4e33-9694-68665c19ada9]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.893389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Processing 1 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:11:54.903859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee412e5-33a5-4778-bd37-ccf7aa6a250f]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.904602 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Processing 1 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:11:54.915617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc51f0fa-4e2c-4710-9113-2a6efb22691f]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.916233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Processing 1 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:11:54.926355 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1afc60-ba63-4b83-b08a-c5a87a47dc93]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.926958 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Processing 1 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:11:54.937199 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3587ebd4-b962-416e-96da-78e3569e783b]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.937964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Processing 1 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:11:54.950261 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab67a902-53ec-4292-9bfc-13e05ef4b1e1]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.951337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Processing 1 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:11:54.978024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[128a8fd2-25cf-4e69-b65a-15814f657ea1]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:54.979105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Subscribe: > agent ovs_restarted 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:54.979815 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Subscribe: > SecurityGroupRule after_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:54.980269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Subscribe: > SecurityGroupRule after_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:54.980835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Subscribe: > Port after_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:54.981303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Subscribe: > Port after_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:54.981891 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Subscribe: > AddressGroup after_update 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:54.982305 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Subscribe: > AddressGroup after_delete 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:55.062840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.driver.init_handler-8740077230574'] for Open vSwitch agent (None), after_init {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:11:55.064139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Subscribe: > ovsdb after_read 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:55.065595 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Subscribe: > Trunk before_create 55550000 {{(pid=107232) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 27 04:11:55.066276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Registering callback for Trunk {{(pid=107232) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 27 04:11:55.066729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Registering callback for SubPort {{(pid=107232) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 27 04:11:55.145009 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Unregistering callback for Trunk {{(pid=107232) unregister /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:72}} Sep 27 04:11:55.145282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent initialized successfully, now running... Sep 27 04:11:55.146526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.ovs_vsctl_cmd', '--privsep_sock_path', '/tmp/tmpij98y_mq/privsep.sock'] Sep 27 04:11:55.161915 dv-cinder-859186-3-iscsi sudo[108978]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.ovs_vsctl_cmd --privsep_sock_path /tmp/tmpij98y_mq/privsep.sock Sep 27 04:11:55.162737 dv-cinder-859186-3-iscsi sudo[108978]: pam_unix(sudo:session): session opened for user root by (uid=0) Sep 27 04:11:56.433154 dv-cinder-859186-3-iscsi sudo[108978]: pam_unix(sudo:session): session closed for user root Sep 27 04:11:56.435061 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Spawned new privsep daemon via rootwrap Sep 27 04:11:56.435648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Accepted privsep connection to /tmp/tmpij98y_mq/privsep.sock {{(pid=107232) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Sep 27 04:11:56.436679 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 27 04:11:56.436943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 27 04:11:56.437200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 27 04:11:56.437450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 108987 Sep 27 04:11:56.440186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ffc69a-1e10-4822-b8e4-ff59267fdfdd]: (2,) {{(pid=108987) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:56.653872 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 {{(pid=108987) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 27 04:11:56.660399 dv-cinder-859186-3-iscsi ovs-vsctl[108991]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=10 --id=@manager -- create Manager "target=\"ptcp:6640:127.0.0.1\"" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 Sep 27 04:11:56.663310 dv-cinder-859186-3-iscsi ovs-vsctl[108991]: ovs|00002|db_ctl_base|ERR|multiple rows in Manager match "ptcp:6640:127.0.0.1" Sep 27 04:11:56.665019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo_concurrency.processutils [-] CMD "ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000" returned: 1 in 0.011s {{(pid=108987) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 27 04:11:56.665430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1836248b-4c92-4baa-b5bb-1f2c90db2233]: (4, ('', 'ovs-vsctl: multiple rows in Manager match "ptcp:6640:127.0.0.1"\n')) {{(pid=108987) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:11:56.666263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Launching async process [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]. {{(pid=107232) start /opt/stack/neutron/neutron/agent/common/async_process.py:117}} Sep 27 04:11:56.666701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Running command: ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] {{(pid=107232) create_process /opt/stack/neutron/neutron/agent/linux/utils.py:84}} Sep 27 04:11:56.674506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:11:56.675162 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:0 started Sep 27 04:11:56.680039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9d96f360-a8ae-4b1d-9f10-664eabdf579b","initial","phy-br-data",2,["map",[]]],["8860b820-fc63-44b2-8411-57732da7304f","initial","eth1",1,["map",[]]],["13fcc040-0323-4e35-9cb4-d7e4b7126a16","initial","br-int",65534,["map",[]]],["3f86125d-98ac-4a83-8414-544ae9f0041f","initial","int-br-data",1,["map",[]]],["841e5d3f-9c58-43b0-af66-076d3a173bb1","initial","br-data",65534,["map",[]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:11:56.681292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22985,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=503000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.682002 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:11:56.682537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:0 - starting polling. Elapsed:0.007 Sep 27 04:11:56.683991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:11:56.684875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:0 - port information retrieved. Elapsed:0.010 Sep 27 04:11:56.685179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Cleaning stale br-int flows Sep 27 04:11:56.685497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reserved cookies for br-int: {11020370386559921740} Sep 27 04:11:56.688447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22987,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=493000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'vlan_vid': 8191}),packet_count=0,priority=65535,table_id=0), OFPFlowStats(byte_count=569,cookie=11020370386559921740,duration_nsec=366000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 1}),packet_count=3,priority=2,table_id=0), OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=510000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=0)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.690330 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22989,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.692139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2298b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.694712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2298d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=519000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.696767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2298f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=24,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=505000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=24)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.698632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22991,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=25,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.700471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22993,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=61,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.702650 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22995,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=30,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=499000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=30)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.704806 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22997,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=31,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=495000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=31)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.706984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22999,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=59,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=526000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=59)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.710183 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2299b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=60,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=523000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=60)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.713586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2299d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=62,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=511000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=62)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.717277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2299f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=801000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionCTClear(experimenter=8992,len=16,subtype=43,type=65535), NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=71,type=65535)],len=40,type=4)],length=104,match=OFPMatch(oxm_fields={'ct_state': (32, 32)}),packet_count=0,priority=110,table_id=71), OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=858000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=71)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.720278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=851000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=72)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.722396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=841000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=73)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.725625 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=77,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.727535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=78,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.729782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=837000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=81)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.732989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=828000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=82)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.735582 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=91,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=799000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=94,type=65535)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=1,table_id=91)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.737655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=92,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=788000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=92)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.739744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=93,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=774000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=93)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.740071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Cleaning stale br-data flows Sep 27 04:11:56.740368 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reserved cookies for br-data: {8472736809372409585} Sep 27 04:11:56.743023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x6ec32e93,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=8472736809372409585,duration_nsec=418000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 2}),packet_count=0,priority=2,table_id=0), OFPFlowStats(byte_count=569,cookie=8472736809372409585,duration_nsec=471000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=3,priority=0,table_id=0)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.745072 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x6ec32e95,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.746937 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x6ec32e97,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.748797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x6ec32e99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=3,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:56.749121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:0 - cleanup stale flows. Elapsed:0.074 Sep 27 04:11:56.749470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:0 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.074 Sep 27 04:11:58.675945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:1 started Sep 27 04:11:58.678822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=502000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:11:58.679378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:11:58.679734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:1 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:00.676460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:2 started Sep 27 04:12:00.679365 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=503000000,duration_sec=10,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:00.679941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:00.680293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:2 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:01.388211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING oslo_policy.policy [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 27 04:12:01.388687 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING oslo_policy.policy [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 27 04:12:01.392985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:12:01Z,description='Default security group',id=a5e2b04d-9a12-43e0-842f-18dbd64039ac,is_default=True,name='default',project_id='146fd1189c56413c9d17cd16d1a974d3',revision_number=1,rules=[SecurityGroupRule(2dda4976-184a-4c94-a6c7-ca9783a2ec11),SecurityGroupRule(5efe5464-c545-491a-a667-b9e2dfbcee1d),SecurityGroupRule(8af04d2a-6963-48f4-a244-bf46aa5388ec),SecurityGroupRule(9c357c16-547d-498b-b0e4-9323ce38133e)],shared=False,stateful=True,updated_at=2022-09-27T04:12:01Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:01.393383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (a5e2b04d-9a12-43e0-842f-18dbd64039ac), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:01.394072 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:12:01Z,description=,direction='ingress',ethertype='IPv6',id=2dda4976-184a-4c94-a6c7-ca9783a2ec11,normalized_cidr=None,port_range_max=,port_range_min=,project_id='146fd1189c56413c9d17cd16d1a974d3',protocol=,remote_address_group_id=,remote_group_id=a5e2b04d-9a12-43e0-842f-18dbd64039ac,remote_ip_prefix=,revision_number=0,security_group_id=a5e2b04d-9a12-43e0-842f-18dbd64039ac,updated_at=2022-09-27T04:12:01Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:01.394438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2dda4976-184a-4c94-a6c7-ca9783a2ec11), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:01.394808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Security group rule updated ['a5e2b04d-9a12-43e0-842f-18dbd64039ac'] Sep 27 04:12:01.395518 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:12:01Z,description=,direction='ingress',ethertype='IPv4',id=5efe5464-c545-491a-a667-b9e2dfbcee1d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='146fd1189c56413c9d17cd16d1a974d3',protocol=,remote_address_group_id=,remote_group_id=a5e2b04d-9a12-43e0-842f-18dbd64039ac,remote_ip_prefix=,revision_number=0,security_group_id=a5e2b04d-9a12-43e0-842f-18dbd64039ac,updated_at=2022-09-27T04:12:01Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:01.395878 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5efe5464-c545-491a-a667-b9e2dfbcee1d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:01.396215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Security group rule updated ['a5e2b04d-9a12-43e0-842f-18dbd64039ac'] Sep 27 04:12:01.397474 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:12:01Z,description=,direction='egress',ethertype='IPv4',id=8af04d2a-6963-48f4-a244-bf46aa5388ec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='146fd1189c56413c9d17cd16d1a974d3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a5e2b04d-9a12-43e0-842f-18dbd64039ac,updated_at=2022-09-27T04:12:01Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:01.397858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8af04d2a-6963-48f4-a244-bf46aa5388ec), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:01.398199 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Security group rule updated ['a5e2b04d-9a12-43e0-842f-18dbd64039ac'] Sep 27 04:12:01.398859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:12:01Z,description=,direction='egress',ethertype='IPv6',id=9c357c16-547d-498b-b0e4-9323ce38133e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='146fd1189c56413c9d17cd16d1a974d3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a5e2b04d-9a12-43e0-842f-18dbd64039ac,updated_at=2022-09-27T04:12:01Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:01.399215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9c357c16-547d-498b-b0e4-9323ce38133e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:01.399547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Security group rule updated ['a5e2b04d-9a12-43e0-842f-18dbd64039ac'] Sep 27 04:12:01.538280 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:12:01Z,description='',dns_domain=None,id=1b8063f2-df42-4727-814a-d2a1930628ae,mtu=1500,name='private',project_id='146fd1189c56413c9d17cd16d1a974d3',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(1b8063f2-df42-4727-814a-d2a1930628ae),segments=[NetworkSegment(a0ec3600-9c46-42f8-90d9-855ac2381cf3)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:12:01Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:01.538830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (1b8063f2-df42-4727-814a-d2a1930628ae), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-261103c0-7181-4523-9c23-efaf40ae475c demo demo] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1b8063f2-df42-4727-814a-d2a1930628ae with segmentation id not found. Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:12:01.683632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:12:01.685085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:12:01.685085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:12:01.685085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:12:01.685085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1b8063f2-df42-4727-814a-d2a1930628ae with segmentation id not found. Sep 27 04:12:01.685085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:12:02.676936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:3 started Sep 27 04:12:02.679472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=504000000,duration_sec=12,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:02.680039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:02.680390 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:3 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:04.677456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:4 started Sep 27 04:12:04.680340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=504000000,duration_sec=14,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:04.680900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:04.681253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:4 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:04.975385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dfda3770-ac18-43f8-b13a-4a04d991464e demo admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(91cea8c0-18c5-4b34-9961-6b10a2cea7a1)],cidr=172.20.0.0/26,created_at=2022-09-27T04:12:04Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=42880daf-24d6-453f-9b2d-ec1d0d58b3ab,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='private-subnet',network_id=1b8063f2-df42-4727-814a-d2a1930628ae,project_id='146fd1189c56413c9d17cd16d1a974d3',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id='ea4540b4-9bf3-49fd-a43a-fa121b8515c0',updated_at=2022-09-27T04:12:04Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:04.975778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dfda3770-ac18-43f8-b13a-4a04d991464e demo admin] Publish callbacks [] for Subnet (42880daf-24d6-453f-9b2d-ec1d0d58b3ab), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:05.999885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8d7a8a41-17b5-435e-b776-c7553138310e None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:12:05Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-1b8063f2-df42-4727-814a-d2a1930628ae',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=91be2386-c6f4-4e65-920b-2ddb6d3c06b5,mac_address=fa:16:3e:b3:a2:8f,name='',network_id=1b8063f2-df42-4727-814a-d2a1930628ae,numa_affinity_policy=,project_id='146fd1189c56413c9d17cd16d1a974d3',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(91be2386-c6f4-4e65-920b-2ddb6d3c06b5),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:12:05Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:06.000570 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8d7a8a41-17b5-435e-b776-c7553138310e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (91be2386-c6f4-4e65-920b-2ddb6d3c06b5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:06.246740 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8d7a8a41-17b5-435e-b776-c7553138310e None None] Resource Port 91be2386-c6f4-4e65-920b-2ddb6d3c06b5 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=91be2386-c6f4-4e65-920b-2ddb6d3c06b5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=91be2386-c6f4-4e65-920b-2ddb6d3c06b5,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=91be2386-c6f4-4e65-920b-2ddb6d3c06b5,segment=NetworkSegment(a0ec3600-9c46-42f8-90d9-855ac2381cf3),segment_id=a0ec3600-9c46-42f8-90d9-855ac2381cf3)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:12:06.247250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8d7a8a41-17b5-435e-b776-c7553138310e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (91be2386-c6f4-4e65-920b-2ddb6d3c06b5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:06.678949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:5 started Sep 27 04:12:06.682022 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=506000000,duration_sec=16,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:06.682621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:06.682973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:5 - starting polling. Elapsed:0.005 Sep 27 04:12:06.683874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:06.684706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:5 - port information retrieved. Elapsed:0.007 Sep 27 04:12:06.685075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:5 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 27 04:12:08.678869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:6 started Sep 27 04:12:08.681230 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=505000000,duration_sec=18,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:08.681936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:08.682297 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:6 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:10.679812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:7 started Sep 27 04:12:10.682434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=506000000,duration_sec=20,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:10.682998 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:10.683352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:7 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:12.681145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:8 started Sep 27 04:12:12.683812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=508000000,duration_sec=22,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:12.684907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:12.685359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:8 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:12.964364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fe989b6f-205e-46fe-ba79-39cc93adb11f","insert","tap91be2386-c6",["set",[]],["map",[["attached-mac","fa:16:3e:b3:a2:8f"],["iface-id","91be2386-c6f4-4e65-920b-2ddb6d3c06b5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:12:12.965692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fe989b6f-205e-46fe-ba79-39cc93adb11f","old",null,["set",[]],null],["","new","tap91be2386-c6",2,["map",[["attached-mac","fa:16:3e:b3:a2:8f"],["iface-id","91be2386-c6f4-4e65-920b-2ddb6d3c06b5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:12:14.682515 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:9 started Sep 27 04:12:14.685221 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229c3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=509000000,duration_sec=24,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:14.686072 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:14.686540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:9 - starting polling. Elapsed:0.004 Sep 27 04:12:14.687701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:14.688778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:9 - port information retrieved. Elapsed:0.006 Sep 27 04:12:14.689352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:12:14.690082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-1b8063f2-df42-4727-814a-d2a1930628ae', 'network_id': '1b8063f2-df42-4727-814a-d2a1930628ae', 'port_id': '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'mac_address': 'fa:16:3e:b3:a2:8f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '42880daf-24d6-453f-9b2d-ec1d0d58b3ab', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:12:14.690990 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 91be2386-c6f4-4e65-920b-2ddb6d3c06b5 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:12:14.691371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 91be2386-c6f4-4e65-920b-2ddb6d3c06b5 updated. Details: {'device': '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-1b8063f2-df42-4727-814a-d2a1930628ae', 'network_id': '1b8063f2-df42-4727-814a-d2a1930628ae', 'port_id': '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'mac_address': 'fa:16:3e:b3:a2:8f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '42880daf-24d6-453f-9b2d-ec1d0d58b3ab', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:12:14.691783 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 1 as local vlan for net-id=1b8063f2-df42-4727-814a-d2a1930628ae, seg-id=138 Sep 27 04:12:14.696928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9eba02a0-7eeb-48a0-8f0f-a11de08b49fc None None] Resource Port 91be2386-c6f4-4e65-920b-2ddb6d3c06b5 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:12:14.697310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9eba02a0-7eeb-48a0-8f0f-a11de08b49fc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (91be2386-c6f4-4e65-920b-2ddb6d3c06b5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:14.700835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32e9b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4234), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4097}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:14.703477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc229c5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4097)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4234}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:14.704525 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap91be2386-c6, col_values=(('tag', 1),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:14.704970 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap91be2386-c6, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:14.705412 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap91be2386-c6, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:14.710064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap91be2386-c6, col_values=(('other_config', {'net_uuid': '1b8063f2-df42-4727-814a-d2a1930628ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '138'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:14.716885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc229c7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:14.717253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:9 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.028 Sep 27 04:12:14.717627 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:12:14.718429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'91be2386-c6f4-4e65-920b-2ddb6d3c06b5'} Sep 27 04:12:14.719855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:12:14.720153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:12:14.722567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:12:14.769626 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b13b5c7-ca99-45e1-a6ff-e72a0b16f89a]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:12:14.770268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:9 - agent port security group processed in 0.080 Sep 27 04:12:14.770833 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 91be2386-c6f4-4e65-920b-2ddb6d3c06b5 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:12:14.968822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['91be2386-c6f4-4e65-920b-2ddb6d3c06b5'] and devices down [] completed. Sep 27 04:12:14.969146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:9 - ports processed. Elapsed:0.287 Sep 27 04:12:14.969483 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:9 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.287 Sep 27 04:12:16.683125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:10 started Sep 27 04:12:16.685810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=510000000,duration_sec=26,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:16.686367 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:16.686705 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:10 - starting polling. Elapsed:0.004 Sep 27 04:12:16.687649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:16.688503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:10 - port information retrieved. Elapsed:0.006 Sep 27 04:12:16.688820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': set(), 'updated': {'91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:12:16.689371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-1b8063f2-df42-4727-814a-d2a1930628ae', 'network_id': '1b8063f2-df42-4727-814a-d2a1930628ae', 'port_id': '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'mac_address': 'fa:16:3e:b3:a2:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '42880daf-24d6-453f-9b2d-ec1d0d58b3ab', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:12:16.690201 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 91be2386-c6f4-4e65-920b-2ddb6d3c06b5 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:12:16.690518 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 91be2386-c6f4-4e65-920b-2ddb6d3c06b5 updated. Details: {'device': '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-1b8063f2-df42-4727-814a-d2a1930628ae', 'network_id': '1b8063f2-df42-4727-814a-d2a1930628ae', 'port_id': '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'mac_address': 'fa:16:3e:b3:a2:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '42880daf-24d6-453f-9b2d-ec1d0d58b3ab', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Sep 27 04:12:16.691491 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap91be2386-c6, col_values=(('tag', 1),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:16.691901 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap91be2386-c6, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:16.692285 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap91be2386-c6, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:16.692718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:12:16.693445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap91be2386-c6, col_values=(('other_config', {'net_uuid': '1b8063f2-df42-4727-814a-d2a1930628ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '138', 'tag': '1'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:16.694151 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:12:16.696158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc229cb,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:16.696492 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:10 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.007 Sep 27 04:12:16.696835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:12:16.697119 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:12:16.698251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:12:16.698536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:12:16.700075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:12:16.736181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9a1328-1119-4bb6-820d-4a82eaf20a1d]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:12:16.737272 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:10 - agent port security group processed in 0.048 Sep 27 04:12:16.737858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 91be2386-c6f4-4e65-920b-2ddb6d3c06b5 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:12:16.864581 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['91be2386-c6f4-4e65-920b-2ddb6d3c06b5'] and devices down [] completed. Sep 27 04:12:16.864910 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:10 - ports processed. Elapsed:0.182 Sep 27 04:12:16.865278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:10 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.182 Sep 27 04:12:18.684429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:11 started Sep 27 04:12:18.686782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=511000000,duration_sec=28,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:18.687340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:18.687692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:11 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:20.684802 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:12 started Sep 27 04:12:20.687259 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=511000000,duration_sec=30,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:20.687878 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:20.688361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:12 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:20.810346 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:12:20Z,description='Default security group',id=1139b7f6-e09f-4f0d-9948-99d07539e95e,is_default=True,name='default',project_id='3cc5c8e99cb64893a8d035d6aa4f3eb6',revision_number=1,rules=[SecurityGroupRule(6edbd234-fc5b-45b8-ac9e-34c7236f9f39),SecurityGroupRule(96df68b3-5848-4c47-8b6e-8746d6023140),SecurityGroupRule(a7cdccb3-d51d-473c-8205-d9bd7491e9a2),SecurityGroupRule(b3a5850c-8580-4084-abbe-d4e34eaa7ec7)],shared=False,stateful=True,updated_at=2022-09-27T04:12:20Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:20.810679 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (1139b7f6-e09f-4f0d-9948-99d07539e95e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:20.811433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:12:20Z,description=,direction='egress',ethertype='IPv6',id=6edbd234-fc5b-45b8-ac9e-34c7236f9f39,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3cc5c8e99cb64893a8d035d6aa4f3eb6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1139b7f6-e09f-4f0d-9948-99d07539e95e,updated_at=2022-09-27T04:12:20Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:20.811801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6edbd234-fc5b-45b8-ac9e-34c7236f9f39), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:20.812208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Security group rule updated ['1139b7f6-e09f-4f0d-9948-99d07539e95e'] Sep 27 04:12:20.812887 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:12:20Z,description=,direction='ingress',ethertype='IPv4',id=96df68b3-5848-4c47-8b6e-8746d6023140,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3cc5c8e99cb64893a8d035d6aa4f3eb6',protocol=,remote_address_group_id=,remote_group_id=1139b7f6-e09f-4f0d-9948-99d07539e95e,remote_ip_prefix=,revision_number=0,security_group_id=1139b7f6-e09f-4f0d-9948-99d07539e95e,updated_at=2022-09-27T04:12:20Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:20.813300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (96df68b3-5848-4c47-8b6e-8746d6023140), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:20.813638 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Security group rule updated ['1139b7f6-e09f-4f0d-9948-99d07539e95e'] Sep 27 04:12:20.814353 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:12:20Z,description=,direction='ingress',ethertype='IPv6',id=a7cdccb3-d51d-473c-8205-d9bd7491e9a2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3cc5c8e99cb64893a8d035d6aa4f3eb6',protocol=,remote_address_group_id=,remote_group_id=1139b7f6-e09f-4f0d-9948-99d07539e95e,remote_ip_prefix=,revision_number=0,security_group_id=1139b7f6-e09f-4f0d-9948-99d07539e95e,updated_at=2022-09-27T04:12:20Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:20.814706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a7cdccb3-d51d-473c-8205-d9bd7491e9a2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:20.815035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Security group rule updated ['1139b7f6-e09f-4f0d-9948-99d07539e95e'] Sep 27 04:12:20.815744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:12:20Z,description=,direction='egress',ethertype='IPv4',id=b3a5850c-8580-4084-abbe-d4e34eaa7ec7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3cc5c8e99cb64893a8d035d6aa4f3eb6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1139b7f6-e09f-4f0d-9948-99d07539e95e,updated_at=2022-09-27T04:12:20Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:20.816094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b3a5850c-8580-4084-abbe-d4e34eaa7ec7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:20.816424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Security group rule updated ['1139b7f6-e09f-4f0d-9948-99d07539e95e'] Sep 27 04:12:20.990156 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:12:20Z,description='',dns_domain=None,id=4c2326fb-b4db-42c7-9331-4377c9818745,mtu=1500,name='public',project_id='3cc5c8e99cb64893a8d035d6aa4f3eb6',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(4c2326fb-b4db-42c7-9331-4377c9818745),segments=[NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:12:20Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:20.990674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3f44b79c-96e5-4405-8f75-82ad493983be admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (4c2326fb-b4db-42c7-9331-4377c9818745), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:22.685880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:13 started Sep 27 04:12:22.688335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=512000000,duration_sec=32,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:22.688921 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:22.689275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:13 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:24.686946 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:14 started Sep 27 04:12:24.689229 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=513000000,duration_sec=34,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:24.689825 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:24.690180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:14 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:12:25.153387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-33dea2a2-74e7-428e-afeb-61bbe4121c97 demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:12:24Z,data_plane_status=None,description='',device_id='5eb8ecfa-a668-47ce-98c7-b742181dafb8',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9,mac_address=fa:16:3e:ca:64:3f,name='',network_id=1b8063f2-df42-4727-814a-d2a1930628ae,numa_affinity_policy=,project_id='146fd1189c56413c9d17cd16d1a974d3',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:12:24Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:25.153880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-33dea2a2-74e7-428e-afeb-61bbe4121c97 demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:25.627084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-33dea2a2-74e7-428e-afeb-61bbe4121c97 demo admin] Received resource Port update without any changes: 6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9 {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:12:26.687918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:15 started Sep 27 04:12:26.691128 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=515000000,duration_sec=36,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:26.691932 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:26.692273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:15 - starting polling. Elapsed:0.005 Sep 27 04:12:26.693468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:26.694905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:15 - port information retrieved. Elapsed:0.007 Sep 27 04:12:26.695244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:15 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 27 04:12:27.374284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-11485208-d68a-43c7-9837-184c15c0cd80 None None] Resource Port 6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:12:27.374667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-11485208-d68a-43c7-9837-184c15c0cd80 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:27.608400 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-11485208-d68a-43c7-9837-184c15c0cd80 None None] Resource Port 6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9,segment=NetworkSegment(a0ec3600-9c46-42f8-90d9-855ac2381cf3),segment_id=a0ec3600-9c46-42f8-90d9-855ac2381cf3)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:12:27.608951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-11485208-d68a-43c7-9837-184c15c0cd80 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:28.131846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7ca924d3-bcb4-45e8-ab10-69b790edc927 None None] Resource Port 6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:12:28.132465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7ca924d3-bcb4-45e8-ab10-69b790edc927 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:28.689489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:16 started Sep 27 04:12:28.692337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=516000000,duration_sec=38,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:28.692916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:28.693262 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:16 - starting polling. Elapsed:0.004 Sep 27 04:12:28.694897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:28.695756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:16 - port information retrieved. Elapsed:0.007 Sep 27 04:12:28.696088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:16 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 27 04:12:29.374266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e8a54c67-68b6-44bc-9457-5bbd0a820e0f admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(23b5a13d-7059-4f0f-b715-89b8a840467c)],cidr=172.27.0.0/24,created_at=2022-09-27T04:12:29Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.27.0.1,host_routes=[],id=65648eee-291b-4b8a-95c0-f3ca12df09c9,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='public-subnet',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,project_id='3cc5c8e99cb64893a8d035d6aa4f3eb6',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:12:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:29.374880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e8a54c67-68b6-44bc-9457-5bbd0a820e0f admin admin] Publish callbacks [] for Subnet (65648eee-291b-4b8a-95c0-f3ca12df09c9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:30.690132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:17 started Sep 27 04:12:30.693026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=517000000,duration_sec=40,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:30.693675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:30.694230 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:17 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:32.576994 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["65c8687b-697c-465a-8a36-7681e64e7002","insert","qr-6dd4abab-9e",["set",[]],["map",[["attached-mac","fa:16:3e:ca:64:3f"],["iface-id","6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:12:32.605115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["65c8687b-697c-465a-8a36-7681e64e7002","old",null,["set",[]],null],["","new","qr-6dd4abab-9e",3,["map",[["attached-mac","fa:16:3e:ca:64:3f"],["iface-id","6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:12:32.692719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:18 started Sep 27 04:12:32.696641 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=521000000,duration_sec=42,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:32.697208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:32.697670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:18 - starting polling. Elapsed:0.005 Sep 27 04:12:32.698749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:32.699750 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:18 - port information retrieved. Elapsed:0.007 Sep 27 04:12:32.700070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:12:32.700625 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'device_id': '5eb8ecfa-a668-47ce-98c7-b742181dafb8', 'network_id': '1b8063f2-df42-4727-814a-d2a1930628ae', 'port_id': '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'mac_address': 'fa:16:3e:ca:64:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '42880daf-24d6-453f-9b2d-ec1d0d58b3ab', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:12:32.701591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:12:32.701992 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9 updated. Details: {'device': '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'device_id': '5eb8ecfa-a668-47ce-98c7-b742181dafb8', 'network_id': '1b8063f2-df42-4727-814a-d2a1930628ae', 'port_id': '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'mac_address': 'fa:16:3e:ca:64:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '42880daf-24d6-453f-9b2d-ec1d0d58b3ab', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Sep 27 04:12:32.702890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6dd4abab-9e, col_values=(('tag', 1),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:32.703300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-6dd4abab-9e, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:32.703731 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-6dd4abab-9e, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:32.710963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6dd4abab-9e, col_values=(('other_config', {'net_uuid': '1b8063f2-df42-4727-814a-d2a1930628ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '138'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:32.720859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc229dd,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:32.721377 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:18 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 2 devices currently available. Time elapsed: 0.021 Sep 27 04:12:32.721863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:12:32.722238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'} Sep 27 04:12:32.723454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:12:32.723926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:12:32.726260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:12:32.764231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa9c24c-c980-4fa0-8776-a41461d362e3]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:12:32.764856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:18 - agent port security group processed in 0.064 Sep 27 04:12:32.765430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:12:32.898964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'] and devices down [] completed. Sep 27 04:12:32.899458 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:18 - ports processed. Elapsed:0.207 Sep 27 04:12:32.899895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:18 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.207 Sep 27 04:12:33.582698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e5520928-bd9b-4ef0-a683-4915e4f7cb8d demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:12:33Z,data_plane_status=None,description='',device_id='5eb8ecfa-a668-47ce-98c7-b742181dafb8',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f4c870bd-9fa2-4569-9b20-42c3918b2981,mac_address=fa:16:3e:62:ea:0e,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f4c870bd-9fa2-4569-9b20-42c3918b2981),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:12:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:12:33.583251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e5520928-bd9b-4ef0-a683-4915e4f7cb8d demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f4c870bd-9fa2-4569-9b20-42c3918b2981), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:34.694446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:19 started Sep 27 04:12:34.697057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229df,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=521000000,duration_sec=44,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:34.697629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:34.698094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:19 - starting polling. Elapsed:0.004 Sep 27 04:12:34.699160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:34.700174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:19 - port information retrieved. Elapsed:0.007 Sep 27 04:12:34.700509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:19 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 27 04:12:35.405897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7e98bb7a-c21c-40f2-b155-f52b28b910cc None None] Resource Port f4c870bd-9fa2-4569-9b20-42c3918b2981 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=f4c870bd-9fa2-4569-9b20-42c3918b2981,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=f4c870bd-9fa2-4569-9b20-42c3918b2981,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:12:35.406792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7e98bb7a-c21c-40f2-b155-f52b28b910cc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f4c870bd-9fa2-4569-9b20-42c3918b2981), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:35.576849 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7e98bb7a-c21c-40f2-b155-f52b28b910cc None None] Resource Port f4c870bd-9fa2-4569-9b20-42c3918b2981 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=f4c870bd-9fa2-4569-9b20-42c3918b2981,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=f4c870bd-9fa2-4569-9b20-42c3918b2981,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=f4c870bd-9fa2-4569-9b20-42c3918b2981,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:12:35.577240 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7e98bb7a-c21c-40f2-b155-f52b28b910cc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f4c870bd-9fa2-4569-9b20-42c3918b2981), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:35.902687 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["34884123-c478-461a-8045-10a847c1c6f4","insert","qg-f4c870bd-9f",["set",[]],["map",[["attached-mac","fa:16:3e:62:ea:0e"],["iface-id","f4c870bd-9fa2-4569-9b20-42c3918b2981"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:12:35.917983 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["34884123-c478-461a-8045-10a847c1c6f4","old",null,["set",[]],null],["","new","qg-f4c870bd-9f",4,["map",[["attached-mac","fa:16:3e:62:ea:0e"],["iface-id","f4c870bd-9fa2-4569-9b20-42c3918b2981"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:12:36.694645 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:20 started Sep 27 04:12:36.697079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=521000000,duration_sec=46,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:36.697652 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:36.698329 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:20 - starting polling. Elapsed:0.004 Sep 27 04:12:36.699490 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:36.700639 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:20 - port information retrieved. Elapsed:0.006 Sep 27 04:12:36.700963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'f4c870bd-9fa2-4569-9b20-42c3918b2981'}, 'removed': set(), 'updated': {'f4c870bd-9fa2-4569-9b20-42c3918b2981'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:12:36.701590 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'device_id': '5eb8ecfa-a668-47ce-98c7-b742181dafb8', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'mac_address': 'fa:16:3e:62:ea:0e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.96'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:12:36.702753 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: f4c870bd-9fa2-4569-9b20-42c3918b2981 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:12:36.703091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port f4c870bd-9fa2-4569-9b20-42c3918b2981 updated. Details: {'device': 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'device_id': '5eb8ecfa-a668-47ce-98c7-b742181dafb8', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'mac_address': 'fa:16:3e:62:ea:0e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.96'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:12:36.703426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 2 as local vlan for net-id=4c2326fb-b4db-42c7-9331-4377c9818745, seg-id=None Sep 27 04:12:36.706250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x6ec32e9d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPopVlan(len=8,type=18), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=32,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4098}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:36.708751 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xbc229e3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPushVlan(ethertype=33024,len=8,type=17), OFPActionSetField(vlan_vid=4098)],len=32,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 0}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:36.710238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f4c870bd-9f, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:36.710671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-f4c870bd-9f, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:36.711178 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-f4c870bd-9f, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:36.715404 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f4c870bd-9f, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:36.722028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc229e5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:36.722443 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:20 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.021 Sep 27 04:12:36.722791 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:12:36.723093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'f4c870bd-9fa2-4569-9b20-42c3918b2981'} Sep 27 04:12:36.724215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:12:36.724497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:12:36.726989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:12:36.765252 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33eda5e-e44c-443d-8c76-f24698b31be1]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:12:36.765912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:20 - agent port security group processed in 0.065 Sep 27 04:12:36.766517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for f4c870bd-9fa2-4569-9b20-42c3918b2981 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:12:36.920573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['f4c870bd-9fa2-4569-9b20-42c3918b2981'] and devices down [] completed. Sep 27 04:12:36.921563 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:20 - ports processed. Elapsed:0.227 Sep 27 04:12:36.922069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:20 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.228 Sep 27 04:12:36.968832 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port f4c870bd-9fa2-4569-9b20-42c3918b2981 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=f4c870bd-9fa2-4569-9b20-42c3918b2981,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=f4c870bd-9fa2-4569-9b20-42c3918b2981,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:12:36.969215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f4c870bd-9fa2-4569-9b20-42c3918b2981), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:38.695471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:21 started Sep 27 04:12:38.698379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=522000000,duration_sec=48,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:38.698624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:38.699812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:21 - starting polling. Elapsed:0.004 Sep 27 04:12:38.700276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:12:38.701433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:21 - port information retrieved. Elapsed:0.006 Sep 27 04:12:38.701852 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': set(), 'updated': {'f4c870bd-9fa2-4569-9b20-42c3918b2981'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:12:38.702617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'device_id': '5eb8ecfa-a668-47ce-98c7-b742181dafb8', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'mac_address': 'fa:16:3e:62:ea:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.96'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:12:38.703811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: f4c870bd-9fa2-4569-9b20-42c3918b2981 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:12:38.704143 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port f4c870bd-9fa2-4569-9b20-42c3918b2981 updated. Details: {'device': 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'device_id': '5eb8ecfa-a668-47ce-98c7-b742181dafb8', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'mac_address': 'fa:16:3e:62:ea:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.96'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:12:38.705279 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f4c870bd-9f, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:38.705546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-f4c870bd-9f, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:38.706008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-f4c870bd-9f, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:38.706456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:12:38.707196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f4c870bd-9f, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:12:38.707966 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:12:38.710420 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc229e9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:38.710760 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:21 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.008 Sep 27 04:12:38.711225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:12:38.711397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:12:38.712629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:12:38.712928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:12:38.714787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:12:38.764402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b5c1e-0ec2-49c2-852c-c6ac9aae0a89]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:12:38.765029 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:21 - agent port security group processed in 0.063 Sep 27 04:12:38.765618 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for f4c870bd-9fa2-4569-9b20-42c3918b2981 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:12:38.906393 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['f4c870bd-9fa2-4569-9b20-42c3918b2981'] and devices down [] completed. Sep 27 04:12:38.906720 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:21 - ports processed. Elapsed:0.211 Sep 27 04:12:38.907062 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:21 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.212 Sep 27 04:12:40.697119 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:22 started Sep 27 04:12:40.699577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=524000000,duration_sec=50,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:40.700335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:40.700702 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:22 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:42.698261 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:23 started Sep 27 04:12:42.702400 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=526000000,duration_sec=52,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:42.703233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:42.703801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:23 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:12:44.699491 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:24 started Sep 27 04:12:44.702324 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=526000000,duration_sec=54,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:44.702893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:44.703605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:24 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:46.700369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:25 started Sep 27 04:12:46.703982 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=528000000,duration_sec=56,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:46.705422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:46.706369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:25 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:12:48.701973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:26 started Sep 27 04:12:48.704464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=529000000,duration_sec=58,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:48.705143 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:48.705582 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:26 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:50.703260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:27 started Sep 27 04:12:50.706021 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=530000000,duration_sec=60,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:50.706591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:50.706953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:27 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:52.704165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:28 started Sep 27 04:12:52.707653 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=531000000,duration_sec=62,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:52.709734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:52.710322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:28 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:12:54.705985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:29 started Sep 27 04:12:54.709168 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=533000000,duration_sec=64,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:54.710256 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:54.710616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:29 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:12:56.707071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:30 started Sep 27 04:12:56.709738 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=534000000,duration_sec=66,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:56.710662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:56.711194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:30 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:12:58.708142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:31 started Sep 27 04:12:58.711949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=536000000,duration_sec=68,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:12:58.712926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:12:58.713592 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:31 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:13:00.709105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:32 started Sep 27 04:13:00.713646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc229ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=537000000,duration_sec=70,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:00.714775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:00.715347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:32 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:13:02.710505 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:33 started Sep 27 04:13:02.713184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a01,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=537000000,duration_sec=72,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:02.713843 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:02.714289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:33 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:04.711703 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:34 started Sep 27 04:13:04.714463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a03,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=538000000,duration_sec=74,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:04.715197 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:04.715645 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:34 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:06.712131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:35 started Sep 27 04:13:06.716230 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a05,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=540000000,duration_sec=76,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:06.717011 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:06.717409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:35 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:13:08.713673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:36 started Sep 27 04:13:08.721093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a07,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=540000000,duration_sec=78,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:08.721199 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:08.721581 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:36 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:13:10.715036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:37 started Sep 27 04:13:10.717462 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a09,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=542000000,duration_sec=80,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:10.718091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:10.718446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:37 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:12.715927 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:38 started Sep 27 04:13:12.718557 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a0b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=543000000,duration_sec=82,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:12.719107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:12.719479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:38 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:14.717196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:39 started Sep 27 04:13:14.719830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a0d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=544000000,duration_sec=84,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:14.720444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:14.720817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:39 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:16.717937 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:40 started Sep 27 04:13:16.720355 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a0f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=544000000,duration_sec=86,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:16.720939 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:16.721294 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:40 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:18.718596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:41 started Sep 27 04:13:18.721293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a11,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=545000000,duration_sec=88,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:18.721928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:18.722287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:41 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:20.724781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:42 started Sep 27 04:13:20.761564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a13,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=569000000,duration_sec=90,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:20.763032 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:20.763908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:42 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.039 Sep 27 04:13:22.726217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:43 started Sep 27 04:13:22.729182 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a15,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=553000000,duration_sec=92,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:22.730056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:22.730415 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:43 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:24.727202 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:44 started Sep 27 04:13:24.731186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a17,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=555000000,duration_sec=94,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:24.732037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:24.732597 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:44 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:13:26.728304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:45 started Sep 27 04:13:26.731684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a19,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=556000000,duration_sec=96,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:26.732435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:26.732963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:45 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:13:28.729360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:46 started Sep 27 04:13:28.732249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a1b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=556000000,duration_sec=98,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:28.732829 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:28.733379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:46 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:30.730773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:47 started Sep 27 04:13:30.733938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a1d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=558000000,duration_sec=100,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:30.734697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:30.735045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:47 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:32.731621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:48 started Sep 27 04:13:32.734190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a1f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=558000000,duration_sec=102,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:32.735065 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:32.735548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:48 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:34.733133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:49 started Sep 27 04:13:34.735740 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a21,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=560000000,duration_sec=104,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:34.736522 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:34.736886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:49 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:36.734166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:50 started Sep 27 04:13:36.736485 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a23,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=561000000,duration_sec=106,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:36.737077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:36.737437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:50 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:13:38.734904 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:51 started Sep 27 04:13:38.737429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a25,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=562000000,duration_sec=108,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:38.738052 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:38.738412 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:51 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:40.736133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:52 started Sep 27 04:13:40.738549 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a27,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=563000000,duration_sec=110,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:40.739121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:40.739481 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:52 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:42.736897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:53 started Sep 27 04:13:42.739290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a29,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=563000000,duration_sec=112,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:42.739858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:42.740245 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:53 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:13:44.738068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:54 started Sep 27 04:13:44.740442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a2b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=565000000,duration_sec=114,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:44.741592 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:44.742104 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:54 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:46.738968 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:55 started Sep 27 04:13:46.741395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a2d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=566000000,duration_sec=116,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:46.742018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:46.742379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:55 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:48.739581 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:56 started Sep 27 04:13:48.742464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a2f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=566000000,duration_sec=118,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:48.743031 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:48.743412 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:56 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:50.740354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:57 started Sep 27 04:13:50.747354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a31,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=567000000,duration_sec=120,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:50.747948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:50.748304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:57 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:13:52.741509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:58 started Sep 27 04:13:52.744078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a33,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=568000000,duration_sec=122,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:52.744645 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:52.745203 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:58 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:54.742600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:59 started Sep 27 04:13:54.745004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a35,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=569000000,duration_sec=124,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:54.745604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:54.745986 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:59 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:56.743941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:60 started Sep 27 04:13:56.746304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a37,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=570000000,duration_sec=126,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:56.746876 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:56.747416 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:60 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:13:58.744613 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:61 started Sep 27 04:13:58.747003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a39,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=571000000,duration_sec=128,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:13:58.747593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:13:58.747942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:61 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:00.745767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:62 started Sep 27 04:14:00.748195 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a3b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=572000000,duration_sec=130,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:00.748776 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:00.749134 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:62 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:02.746649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:63 started Sep 27 04:14:02.749055 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a3d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=573000000,duration_sec=132,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:02.749615 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:02.750006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:63 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:04.747335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:64 started Sep 27 04:14:04.749855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a3f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=574000000,duration_sec=134,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:04.750454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:04.750809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:64 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:06.748539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:65 started Sep 27 04:14:06.750935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a41,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=575000000,duration_sec=136,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:06.751801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:06.752157 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:65 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:07.086282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-feb25b60-5a46-41af-9485-f48d0ecdd7a0 admin admin] Resource Subnet 42880daf-24d6-453f-9b2d-ec1d0d58b3ab updated (revision_number 0->1). Old fields: {'dns_nameservers': []} New fields: {'dns_nameservers': [DNSNameServer(address='8.8.8.8',order=0,subnet_id=42880daf-24d6-453f-9b2d-ec1d0d58b3ab), DNSNameServer(address='8.8.4.4',order=1,subnet_id=42880daf-24d6-453f-9b2d-ec1d0d58b3ab)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:14:07.086658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-feb25b60-5a46-41af-9485-f48d0ecdd7a0 admin admin] Publish callbacks [] for Subnet (42880daf-24d6-453f-9b2d-ec1d0d58b3ab), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:14:08.749769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:66 started Sep 27 04:14:08.752320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a43,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=576000000,duration_sec=138,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:08.752886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:08.753242 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:66 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:10.750621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:67 started Sep 27 04:14:10.753008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a45,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=577000000,duration_sec=140,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:10.753567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:10.753948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:67 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:14:12.751585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:68 started Sep 27 04:14:12.754351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a47,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=578000000,duration_sec=142,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:12.754934 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:12.755295 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:68 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:14.752718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:69 started Sep 27 04:14:14.755527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a49,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=579000000,duration_sec=144,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:14.756093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:14.756453 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:69 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:16.753596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:70 started Sep 27 04:14:16.755973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a4b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=580000000,duration_sec=146,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:16.756544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:16.757608 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:70 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:18.754929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:71 started Sep 27 04:14:18.757991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a4d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=582000000,duration_sec=148,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:18.758567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:18.758920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:71 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:20.756239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:72 started Sep 27 04:14:20.758712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a4f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=583000000,duration_sec=150,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:20.759295 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:20.759650 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:72 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:22.758097 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:73 started Sep 27 04:14:22.760536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=585000000,duration_sec=152,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:22.761123 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:22.761470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:73 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:24.758778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:74 started Sep 27 04:14:24.765639 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a53,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=585000000,duration_sec=154,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:24.767126 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:24.767484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:74 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:14:26.759758 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:75 started Sep 27 04:14:26.762209 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a55,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=586000000,duration_sec=156,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:26.762770 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:26.763125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:75 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:28.760856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:76 started Sep 27 04:14:28.763328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a57,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=587000000,duration_sec=158,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:28.763894 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:28.764246 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:76 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:30.761494 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:77 started Sep 27 04:14:30.763931 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a59,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=588000000,duration_sec=160,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:30.764478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:30.764831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:77 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:32.762892 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:78 started Sep 27 04:14:32.765524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=590000000,duration_sec=162,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:32.766102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:32.766465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:78 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:34.764367 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:79 started Sep 27 04:14:34.767497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a5d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=591000000,duration_sec=164,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:34.768058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:34.768433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:79 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:36.765432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:80 started Sep 27 04:14:36.768040 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=592000000,duration_sec=166,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:36.768606 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:36.768961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:80 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:38.766258 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:81 started Sep 27 04:14:38.769041 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a61,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=593000000,duration_sec=168,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:38.769604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:38.769993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:81 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:40.767587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:82 started Sep 27 04:14:40.770293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=594000000,duration_sec=170,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:40.770858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:40.771215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:82 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:42.768426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:83 started Sep 27 04:14:42.771008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a65,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=595000000,duration_sec=172,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:42.771578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:42.771934 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:83 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:44.769947 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:84 started Sep 27 04:14:44.772423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=597000000,duration_sec=174,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:44.772996 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:44.773354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:84 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:46.771058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:85 started Sep 27 04:14:46.774054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a69,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=598000000,duration_sec=176,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:46.774615 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:46.774973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:85 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:48.772588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:86 started Sep 27 04:14:48.775064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a6b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=599000000,duration_sec=178,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:48.775717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:48.776115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:86 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:50.773335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:87 started Sep 27 04:14:50.776232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a6d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=600000000,duration_sec=180,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:50.776840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:50.777220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:87 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:52.774306 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:88 started Sep 27 04:14:52.776762 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=601000000,duration_sec=182,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:52.777341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:52.777717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:88 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:54.775344 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:89 started Sep 27 04:14:54.777883 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a71,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=602000000,duration_sec=184,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:54.778497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:54.778852 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:89 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:56.776703 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:90 started Sep 27 04:14:56.779320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a73,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=603000000,duration_sec=186,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:56.779884 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:56.780238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:90 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:14:58.777936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:91 started Sep 27 04:14:58.780397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=605000000,duration_sec=188,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:14:58.780968 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:14:58.781322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:91 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:00.778857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:92 started Sep 27 04:15:00.781484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=605000000,duration_sec=190,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:00.782084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:00.782438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:92 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:02.779598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:93 started Sep 27 04:15:02.782102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=606000000,duration_sec=192,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:02.782673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:02.783026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:93 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:04.780822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:94 started Sep 27 04:15:04.783396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=608000000,duration_sec=194,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:04.784046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:04.784401 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:94 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:06.781656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:95 started Sep 27 04:15:06.788442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a7d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=608000000,duration_sec=196,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:06.789057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:06.789951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:95 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:15:07.238070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f2c6e8bb-e31f-4bdb-ae7e-3dedc818bb0a admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:15:07Z,description='',dns_domain=None,id=1659662c-84cd-4ca0-9418-f36b497121ac,mtu=1500,name='shared',project_id='3cc5c8e99cb64893a8d035d6aa4f3eb6',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(1659662c-84cd-4ca0-9418-f36b497121ac),segments=[NetworkSegment(9fed9611-888f-4522-acf6-4e174e3e22fb)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:15:07Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:15:07.238466 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f2c6e8bb-e31f-4bdb-ae7e-3dedc818bb0a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (1659662c-84cd-4ca0-9418-f36b497121ac), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-f2c6e8bb-e31f-4bdb-ae7e-3dedc818bb0a admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1659662c-84cd-4ca0-9418-f36b497121ac with segmentation id not found. Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:15:07.408314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:15:07.409327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:15:07.409327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:15:07.409327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:15:07.409327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1659662c-84cd-4ca0-9418-f36b497121ac with segmentation id not found. Sep 27 04:15:07.409327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:15:08.783463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:96 started Sep 27 04:15:08.785919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a7f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=610000000,duration_sec=198,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:08.786489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:08.786848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:96 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:10.518690 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bd9dc59a-e6b9-40da-b0cb-8b66320477a4 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(59c081be-c9f9-4a1d-a8f4-70aa2844c654)],cidr=192.168.233.0/24,created_at=2022-09-27T04:15:10Z,description='shared-subnet',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=192.168.233.1,host_routes=[],id=5e49f6f7-7be2-4120-9e23-b2c0962d26fc,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='shared-subnet',network_id=1659662c-84cd-4ca0-9418-f36b497121ac,project_id='3cc5c8e99cb64893a8d035d6aa4f3eb6',revision_number=0,segment_id=,service_types=[],shared=True,subnetpool_id=,updated_at=2022-09-27T04:15:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:15:10.519315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bd9dc59a-e6b9-40da-b0cb-8b66320477a4 admin admin] Publish callbacks [] for Subnet (5e49f6f7-7be2-4120-9e23-b2c0962d26fc), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:15:10.784364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:97 started Sep 27 04:15:10.786954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a81,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=611000000,duration_sec=200,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:10.787529 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:10.788123 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:97 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:11.033896 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cc35752a-3739-4723-91c0-aa84cb7ca948 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:15:10Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-1659662c-84cd-4ca0-9418-f36b497121ac',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a9d279c0-f93b-406b-9d35-10eff3cffc78,mac_address=fa:16:3e:f5:e3:34,name='',network_id=1659662c-84cd-4ca0-9418-f36b497121ac,numa_affinity_policy=,project_id='3cc5c8e99cb64893a8d035d6aa4f3eb6',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a9d279c0-f93b-406b-9d35-10eff3cffc78),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:15:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:15:11.034293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cc35752a-3739-4723-91c0-aa84cb7ca948 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a9d279c0-f93b-406b-9d35-10eff3cffc78), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:15:11.258908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cc35752a-3739-4723-91c0-aa84cb7ca948 None None] Resource Port a9d279c0-f93b-406b-9d35-10eff3cffc78 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=a9d279c0-f93b-406b-9d35-10eff3cffc78,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=a9d279c0-f93b-406b-9d35-10eff3cffc78,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=a9d279c0-f93b-406b-9d35-10eff3cffc78,segment=NetworkSegment(9fed9611-888f-4522-acf6-4e174e3e22fb),segment_id=9fed9611-888f-4522-acf6-4e174e3e22fb)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:15:11.260761 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cc35752a-3739-4723-91c0-aa84cb7ca948 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a9d279c0-f93b-406b-9d35-10eff3cffc78), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:15:11.355023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["36ce3883-0664-49a1-9543-486fbab63882","insert","tapa9d279c0-f9",["set",[]],["map",[["attached-mac","fa:16:3e:f5:e3:34"],["iface-id","a9d279c0-f93b-406b-9d35-10eff3cffc78"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:15:11.372932 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["36ce3883-0664-49a1-9543-486fbab63882","old",null,["set",[]],null],["","new","tapa9d279c0-f9",5,["map",[["attached-mac","fa:16:3e:f5:e3:34"],["iface-id","a9d279c0-f93b-406b-9d35-10eff3cffc78"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:15:12.307894 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b855eb4-4d21-46ef-9a9e-c500fc40aba7 None None] Resource Port a9d279c0-f93b-406b-9d35-10eff3cffc78 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:15:12.309075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b855eb4-4d21-46ef-9a9e-c500fc40aba7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a9d279c0-f93b-406b-9d35-10eff3cffc78), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:15:12.785717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:98 started Sep 27 04:15:12.788550 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a83,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=613000000,duration_sec=202,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:12.789853 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:12.790329 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:98 - starting polling. Elapsed:0.005 Sep 27 04:15:12.791645 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:15:12.792964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:98 - port information retrieved. Elapsed:0.007 Sep 27 04:15:12.793297 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'a9d279c0-f93b-406b-9d35-10eff3cffc78'}, 'removed': set(), 'updated': {'a9d279c0-f93b-406b-9d35-10eff3cffc78'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:15:12.793944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-1659662c-84cd-4ca0-9418-f36b497121ac', 'network_id': '1659662c-84cd-4ca0-9418-f36b497121ac', 'port_id': 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'mac_address': 'fa:16:3e:f5:e3:34', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5e49f6f7-7be2-4120-9e23-b2c0962d26fc', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:15:12.795183 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: a9d279c0-f93b-406b-9d35-10eff3cffc78 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:15:12.795536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port a9d279c0-f93b-406b-9d35-10eff3cffc78 updated. Details: {'device': 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-1659662c-84cd-4ca0-9418-f36b497121ac', 'network_id': '1659662c-84cd-4ca0-9418-f36b497121ac', 'port_id': 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'mac_address': 'fa:16:3e:f5:e3:34', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5e49f6f7-7be2-4120-9e23-b2c0962d26fc', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:15:12.795880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 3 as local vlan for net-id=1659662c-84cd-4ca0-9418-f36b497121ac, seg-id=101 Sep 27 04:15:12.798501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32e9f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4197), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4099}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:12.800742 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22a85,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4099)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4197}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:12.801686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapa9d279c0-f9, col_values=(('tag', 3),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:15:12.802140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapa9d279c0-f9, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:15:12.802576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapa9d279c0-f9, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:15:12.807255 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapa9d279c0-f9, col_values=(('other_config', {'net_uuid': '1659662c-84cd-4ca0-9418-f36b497121ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '3', 'segmentation_id': '101'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:15:12.816263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22a87,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 5}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:12.817949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:98 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 4 devices currently available. Time elapsed: 0.023 Sep 27 04:15:12.817949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:15:12.817949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'a9d279c0-f93b-406b-9d35-10eff3cffc78'} Sep 27 04:15:12.818378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:15:12.818697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:15:12.820798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:15:12.857176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a77a88d-b7d1-4bfe-a3d6-e5ec073de679]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:15:12.857923 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:98 - agent port security group processed in 0.064 Sep 27 04:15:12.858593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for a9d279c0-f93b-406b-9d35-10eff3cffc78 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:15:12.985922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['a9d279c0-f93b-406b-9d35-10eff3cffc78'] and devices down [] completed. Sep 27 04:15:12.986254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:98 - ports processed. Elapsed:0.201 Sep 27 04:15:12.986603 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:98 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.201 Sep 27 04:15:14.786608 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:99 started Sep 27 04:15:14.789147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a89,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=613000000,duration_sec=204,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:14.789722 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:14.790203 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:99 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:16.787909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:100 started Sep 27 04:15:16.790485 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a8b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=615000000,duration_sec=206,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:16.791045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:16.791421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:100 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:18.788890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:101 started Sep 27 04:15:18.791450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a8d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=615000000,duration_sec=208,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:18.792008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:18.792362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:101 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:20.790382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:102 started Sep 27 04:15:20.792799 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a8f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=617000000,duration_sec=210,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:20.793359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:20.793712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:102 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:15:22.791845 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:103 started Sep 27 04:15:22.794291 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a91,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=618000000,duration_sec=212,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:22.794889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:22.795252 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:103 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:24.793241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:104 started Sep 27 04:15:24.795683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a93,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=620000000,duration_sec=214,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:24.796250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:24.796610 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:104 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:26.794138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:105 started Sep 27 04:15:26.796870 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a95,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=621000000,duration_sec=216,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:26.797431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:26.797811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:105 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:28.795599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:106 started Sep 27 04:15:28.798081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a97,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=622000000,duration_sec=218,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:28.798663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:28.799016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:106 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:30.796852 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:107 started Sep 27 04:15:30.799405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=624000000,duration_sec=220,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:30.799985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:30.800341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:107 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:32.798275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:108 started Sep 27 04:15:32.801065 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a9b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=625000000,duration_sec=222,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:32.801651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:32.802027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:108 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:34.798962 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:109 started Sep 27 04:15:34.801557 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a9d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=626000000,duration_sec=224,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:34.802157 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:34.802526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:109 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:36.799706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:110 started Sep 27 04:15:36.802160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22a9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=626000000,duration_sec=226,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:36.802710 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:36.803059 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:110 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:38.801172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:111 started Sep 27 04:15:38.803935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aa1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=628000000,duration_sec=228,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:38.804503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:38.805361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:111 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:40.803239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:112 started Sep 27 04:15:40.806226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aa3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=630000000,duration_sec=230,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:40.806790 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:40.807149 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:112 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:42.804119 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:113 started Sep 27 04:15:42.806941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aa5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=631000000,duration_sec=232,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:42.807560 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:42.807918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:113 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:44.805191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:114 started Sep 27 04:15:44.812185 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aa7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=636000000,duration_sec=234,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:44.812752 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:44.813103 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:114 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:15:46.805925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:115 started Sep 27 04:15:46.808448 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aa9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=633000000,duration_sec=236,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:46.809021 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:46.809378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:115 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:48.807061 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:116 started Sep 27 04:15:48.809474 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=634000000,duration_sec=238,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:48.810074 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:48.810437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:116 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:50.807824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:117 started Sep 27 04:15:50.810252 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=634000000,duration_sec=240,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:50.810815 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:50.811163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:117 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:52.809320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:118 started Sep 27 04:15:52.811574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aaf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=636000000,duration_sec=242,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:52.812140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:52.812497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:118 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:15:54.810334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:119 started Sep 27 04:15:54.812758 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ab1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=637000000,duration_sec=244,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:54.813322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:54.813676 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:119 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:56.811705 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:120 started Sep 27 04:15:56.814362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ab3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=638000000,duration_sec=246,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:56.814938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:56.815300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:120 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:15:58.813192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:121 started Sep 27 04:15:58.815824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ab5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=640000000,duration_sec=248,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:15:58.816389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:15:58.816741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:121 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:00.814540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:122 started Sep 27 04:16:00.817026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ab7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=641000000,duration_sec=250,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:00.817591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:00.817982 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:122 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:02.815807 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:123 started Sep 27 04:16:02.818259 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ab9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=642000000,duration_sec=252,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:02.818834 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:02.819219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:123 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:04.817333 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:124 started Sep 27 04:16:04.819744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22abb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=644000000,duration_sec=254,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:04.820316 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:04.821207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:124 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:06.818715 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:125 started Sep 27 04:16:06.821706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22abd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=645000000,duration_sec=256,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:06.822318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:06.822672 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:125 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:08.820130 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:126 started Sep 27 04:16:08.822676 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22abf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=647000000,duration_sec=258,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:08.823236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:08.823588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:126 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:10.820912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:127 started Sep 27 04:16:10.823572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ac1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=648000000,duration_sec=260,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:10.824210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:10.824625 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:127 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:12.822300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:128 started Sep 27 04:16:12.824559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ac3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=649000000,duration_sec=262,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:12.825111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:12.825461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:128 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:16:14.823299 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:129 started Sep 27 04:16:14.825812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ac5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=650000000,duration_sec=264,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:14.826374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:14.826729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:129 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:16.824954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:130 started Sep 27 04:16:16.827772 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ac7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=652000000,duration_sec=266,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:16.828340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:16.828695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:130 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:18.825706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:131 started Sep 27 04:16:18.828258 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ac9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=652000000,duration_sec=268,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:18.828820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:18.829172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:131 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:20.826975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:132 started Sep 27 04:16:20.829517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22acb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=654000000,duration_sec=270,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:20.830123 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:20.830483 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:132 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:22.827813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:133 started Sep 27 04:16:22.830470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22acd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=655000000,duration_sec=272,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:22.831078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:22.831438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:133 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:24.828829 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:134 started Sep 27 04:16:24.831384 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22acf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=656000000,duration_sec=274,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:24.831943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:24.832296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:134 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:26.829771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:135 started Sep 27 04:16:26.832191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ad1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=656000000,duration_sec=276,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:26.832768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:26.833124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:135 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:28.830929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:136 started Sep 27 04:16:28.833277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ad3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=657000000,duration_sec=278,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:28.833938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:28.834292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:136 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:30.787331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:16:30Z,description='Default security group',id=2974777b-1d76-49cb-9bd4-3038d5e2d65e,is_default=True,name='default',project_id='83f865ed3f584f7b9b21f6efd33e6825',revision_number=1,rules=[SecurityGroupRule(10ce167d-1f63-4960-86bc-e316a1a97e62),SecurityGroupRule(7541383b-d26d-473d-9625-bc34ca580899),SecurityGroupRule(83a79fca-8ca6-4ebf-93cd-d9193af3bc00),SecurityGroupRule(f91a6fcb-05cd-49cd-92fe-0dc6f8dbbae3)],shared=False,stateful=True,updated_at=2022-09-27T04:16:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:16:30.787976 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (2974777b-1d76-49cb-9bd4-3038d5e2d65e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:16:30.788330 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:16:30Z,description=,direction='egress',ethertype='IPv6',id=10ce167d-1f63-4960-86bc-e316a1a97e62,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83f865ed3f584f7b9b21f6efd33e6825',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2974777b-1d76-49cb-9bd4-3038d5e2d65e,updated_at=2022-09-27T04:16:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:16:30.788691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (10ce167d-1f63-4960-86bc-e316a1a97e62), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:16:30.789033 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Security group rule updated ['2974777b-1d76-49cb-9bd4-3038d5e2d65e'] Sep 27 04:16:30.790395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:16:30Z,description=,direction='ingress',ethertype='IPv6',id=7541383b-d26d-473d-9625-bc34ca580899,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83f865ed3f584f7b9b21f6efd33e6825',protocol=,remote_address_group_id=,remote_group_id=2974777b-1d76-49cb-9bd4-3038d5e2d65e,remote_ip_prefix=,revision_number=0,security_group_id=2974777b-1d76-49cb-9bd4-3038d5e2d65e,updated_at=2022-09-27T04:16:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:16:30.790752 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7541383b-d26d-473d-9625-bc34ca580899), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:16:30.791085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Security group rule updated ['2974777b-1d76-49cb-9bd4-3038d5e2d65e'] Sep 27 04:16:30.791742 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:16:30Z,description=,direction='egress',ethertype='IPv4',id=83a79fca-8ca6-4ebf-93cd-d9193af3bc00,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83f865ed3f584f7b9b21f6efd33e6825',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2974777b-1d76-49cb-9bd4-3038d5e2d65e,updated_at=2022-09-27T04:16:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:16:30.792096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (83a79fca-8ca6-4ebf-93cd-d9193af3bc00), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:16:30.792430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Security group rule updated ['2974777b-1d76-49cb-9bd4-3038d5e2d65e'] Sep 27 04:16:30.793095 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:16:30Z,description=,direction='ingress',ethertype='IPv4',id=f91a6fcb-05cd-49cd-92fe-0dc6f8dbbae3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83f865ed3f584f7b9b21f6efd33e6825',protocol=,remote_address_group_id=,remote_group_id=2974777b-1d76-49cb-9bd4-3038d5e2d65e,remote_ip_prefix=,revision_number=0,security_group_id=2974777b-1d76-49cb-9bd4-3038d5e2d65e,updated_at=2022-09-27T04:16:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:16:30.793447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f91a6fcb-05cd-49cd-92fe-0dc6f8dbbae3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:16:30.793906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-548364bd-99d0-4a2d-a0cc-e07c2c2b0f49 admin admin] Security group rule updated ['2974777b-1d76-49cb-9bd4-3038d5e2d65e'] Sep 27 04:16:30.831624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:137 started Sep 27 04:16:30.834370 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ad5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=658000000,duration_sec=280,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:30.834977 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:30.835329 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:137 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:30.993821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Resource SecurityGroup deleted: 2974777b-1d76-49cb-9bd4-3038d5e2d65e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:16:30.994280 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (2974777b-1d76-49cb-9bd4-3038d5e2d65e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:16:30.994802 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2974777b-1d76-49cb-9bd4-3038d5e2d65e',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:16:31.014158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2974777b-1d76-49cb-9bd4-3038d5e2d65e',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:16:31.014555 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Resource SecurityGroupRule deleted: 10ce167d-1f63-4960-86bc-e316a1a97e62 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:16:31.014960 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (10ce167d-1f63-4960-86bc-e316a1a97e62), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:16:31.015300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Security group rule updated ['2974777b-1d76-49cb-9bd4-3038d5e2d65e'] Sep 27 04:16:31.015768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Resource SecurityGroupRule deleted: 7541383b-d26d-473d-9625-bc34ca580899 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:16:31.016102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7541383b-d26d-473d-9625-bc34ca580899), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:16:31.016434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Security group rule updated ['2974777b-1d76-49cb-9bd4-3038d5e2d65e'] Sep 27 04:16:31.016814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Resource SecurityGroupRule deleted: 83a79fca-8ca6-4ebf-93cd-d9193af3bc00 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:16:31.017165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (83a79fca-8ca6-4ebf-93cd-d9193af3bc00), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:16:31.017488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Security group rule updated ['2974777b-1d76-49cb-9bd4-3038d5e2d65e'] Sep 27 04:16:31.017893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Resource SecurityGroupRule deleted: f91a6fcb-05cd-49cd-92fe-0dc6f8dbbae3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:16:31.018241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f91a6fcb-05cd-49cd-92fe-0dc6f8dbbae3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:16:31.018564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-558dcce7-db52-42e6-9736-7afd57e03f16 admin admin] Security group rule updated ['2974777b-1d76-49cb-9bd4-3038d5e2d65e'] Sep 27 04:16:32.832654 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:138 started Sep 27 04:16:32.835135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ad7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=659000000,duration_sec=282,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:32.835715 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:32.836144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:138 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:34.834924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:139 started Sep 27 04:16:34.837988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ad9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=662000000,duration_sec=284,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:34.838576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:34.838958 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:139 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:36.836277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:140 started Sep 27 04:16:36.838794 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22adb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=663000000,duration_sec=286,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:36.839359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:36.839716 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:140 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:38.837183 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:141 started Sep 27 04:16:38.839630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22add,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=664000000,duration_sec=288,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:38.840189 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:38.840543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:141 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:40.838165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:142 started Sep 27 04:16:40.840560 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22adf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=665000000,duration_sec=290,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:40.841114 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:40.841464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:142 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:42.838866 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:143 started Sep 27 04:16:42.841100 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ae1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=665000000,duration_sec=292,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:42.841663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:42.842039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:143 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:16:44.840444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:144 started Sep 27 04:16:44.842922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ae3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=667000000,duration_sec=294,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:44.843492 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:44.843842 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:144 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:46.841506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:145 started Sep 27 04:16:46.843902 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ae5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=668000000,duration_sec=296,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:46.844472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:46.844845 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:145 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:48.842964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:146 started Sep 27 04:16:48.845347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ae7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=670000000,duration_sec=298,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:48.845943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:48.846301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:146 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:50.843630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:147 started Sep 27 04:16:50.846006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ae9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=670000000,duration_sec=300,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:50.846579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:50.846927 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:147 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:16:52.844827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:148 started Sep 27 04:16:52.847125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aeb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=671000000,duration_sec=302,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:52.847699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:52.848053 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:148 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:16:54.846222 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:149 started Sep 27 04:16:54.848650 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=673000000,duration_sec=304,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:54.849256 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:54.849609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:149 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:56.847122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:150 started Sep 27 04:16:56.849543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=674000000,duration_sec=306,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:56.850164 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:56.850522 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:150 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:16:58.847936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:151 started Sep 27 04:16:58.850975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22af1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=675000000,duration_sec=308,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:16:58.851540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:16:58.851886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:151 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:00.848730 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:152 started Sep 27 04:17:00.851281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22af3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=675000000,duration_sec=310,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:00.851885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:00.852238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:152 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:02.849248 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:153 started Sep 27 04:17:02.851510 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22af5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=676000000,duration_sec=312,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:02.852082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:02.852436 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:153 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:04.850672 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:154 started Sep 27 04:17:04.853033 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22af7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=677000000,duration_sec=314,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:04.853604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:04.854080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:154 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:06.852253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:155 started Sep 27 04:17:06.855398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22af9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=679000000,duration_sec=316,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:06.856038 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:06.856478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:155 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:08.853369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:156 started Sep 27 04:17:08.855717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22afb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=680000000,duration_sec=318,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:08.856275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:08.856625 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:156 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:10.854770 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:157 started Sep 27 04:17:10.857437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22afd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=682000000,duration_sec=320,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:10.858029 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:10.858379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:157 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:12.855217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:158 started Sep 27 04:17:12.857770 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22aff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=682000000,duration_sec=322,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:12.858371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:12.858728 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:158 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:14.855991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:159 started Sep 27 04:17:14.858439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b01,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=683000000,duration_sec=324,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:14.859005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:14.859357 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:159 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:16.856770 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:160 started Sep 27 04:17:16.859214 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b03,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=683000000,duration_sec=326,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:16.859788 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:16.860141 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:160 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:18.857751 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:161 started Sep 27 04:17:18.860430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b05,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=684000000,duration_sec=328,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:18.860997 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:18.861347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:161 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:20.858839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:162 started Sep 27 04:17:20.861234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b07,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=685000000,duration_sec=330,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:20.861839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:20.862192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:162 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:22.859916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:163 started Sep 27 04:17:22.862192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b09,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=686000000,duration_sec=332,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:22.862760 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:22.863107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:163 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:24.861343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:164 started Sep 27 04:17:24.863706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b0b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=688000000,duration_sec=334,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:24.864283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:24.864640 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:164 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:26.862282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:165 started Sep 27 04:17:26.864623 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b0d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=689000000,duration_sec=336,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:26.865190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:26.865546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:165 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:28.863699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:166 started Sep 27 04:17:28.866051 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b0f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=690000000,duration_sec=338,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:28.866616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:28.866962 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:166 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:30.864306 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:167 started Sep 27 04:17:30.866696 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b11,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=691000000,duration_sec=340,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:30.867286 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:30.867636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:167 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:32.865044 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:168 started Sep 27 04:17:32.871417 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b13,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=692000000,duration_sec=342,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:32.872038 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:32.872391 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:168 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:17:34.866265 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:169 started Sep 27 04:17:34.868589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b15,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=693000000,duration_sec=344,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:34.869151 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:34.869497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:169 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:36.867177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:170 started Sep 27 04:17:36.869487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b17,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=694000000,duration_sec=346,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:36.870129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:36.870479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:170 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:38.868519 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:171 started Sep 27 04:17:38.870840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b19,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=695000000,duration_sec=348,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:38.871408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:38.871803 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:171 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:40.869351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:172 started Sep 27 04:17:40.872268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b1b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=696000000,duration_sec=350,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:40.872833 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:40.873181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:172 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:42.870697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:173 started Sep 27 04:17:42.873988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b1d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=697000000,duration_sec=352,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:42.874565 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:42.874939 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:173 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:44.872035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:174 started Sep 27 04:17:44.874432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b1f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=699000000,duration_sec=354,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:44.875001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:44.875356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:174 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:46.873503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:175 started Sep 27 04:17:46.875909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b21,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=700000000,duration_sec=356,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:46.876480 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:46.876831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:175 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:48.874427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:176 started Sep 27 04:17:48.876764 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b23,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=701000000,duration_sec=358,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:48.877327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:48.877673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:176 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:50.875488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:177 started Sep 27 04:17:50.877947 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b25,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=702000000,duration_sec=360,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:50.878513 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:50.878860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:177 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:52.876744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:178 started Sep 27 04:17:52.878928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b27,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=703000000,duration_sec=362,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:52.879490 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:52.879837 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:178 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:17:54.877491 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:179 started Sep 27 04:17:54.879914 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b29,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=704000000,duration_sec=364,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:54.880504 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:54.880857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:179 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:56.878530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:180 started Sep 27 04:17:56.880965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b2b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=705000000,duration_sec=366,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:56.881530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:56.881912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:180 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:17:58.879695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:181 started Sep 27 04:17:58.882142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b2d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=706000000,duration_sec=368,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:17:58.882721 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:17:58.883077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:181 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:00.880959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:182 started Sep 27 04:18:00.883387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b2f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=708000000,duration_sec=370,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:00.883951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:00.884303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:182 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:02.881727 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:183 started Sep 27 04:18:02.884045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b31,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=708000000,duration_sec=372,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:02.884620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:02.884981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:183 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:18:04.882892 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:184 started Sep 27 04:18:04.885293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b33,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=709000000,duration_sec=374,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:04.885896 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:04.886268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:184 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:06.883937 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:185 started Sep 27 04:18:06.890399 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b35,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=710000000,duration_sec=376,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:06.890987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:06.891341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:185 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:18:08.885246 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:186 started Sep 27 04:18:08.887594 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b37,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=712000000,duration_sec=378,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:08.888164 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:08.888537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:186 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:18:10.886488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:187 started Sep 27 04:18:10.889424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b39,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=713000000,duration_sec=380,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:10.890027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:10.890377 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:187 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:12.887968 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:188 started Sep 27 04:18:12.890636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b3b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=715000000,duration_sec=382,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:12.891238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:12.891591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:188 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:14.889409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:189 started Sep 27 04:18:14.891804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b3d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=716000000,duration_sec=384,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:14.892395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:14.892745 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:189 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:16.890905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:190 started Sep 27 04:18:16.893806 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b3f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=718000000,duration_sec=386,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:16.894385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:16.894746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:190 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:18.891918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:191 started Sep 27 04:18:18.894399 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b41,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=719000000,duration_sec=388,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:18.895082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:18.895439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:191 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:20.892975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:192 started Sep 27 04:18:20.895591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b43,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=720000000,duration_sec=390,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:20.896174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:20.896537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:192 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:22.893734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:193 started Sep 27 04:18:22.896117 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b45,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=720000000,duration_sec=392,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:22.896760 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:22.897143 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:193 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:24.895164 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:194 started Sep 27 04:18:24.898244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b47,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=722000000,duration_sec=394,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:24.899105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:24.899460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:194 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:26.896550 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:195 started Sep 27 04:18:26.899492 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b49,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=723000000,duration_sec=396,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:26.900049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:26.900405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:195 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:28.897648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:196 started Sep 27 04:18:28.900342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b4b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=724000000,duration_sec=398,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:28.900937 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:28.901292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:196 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:30.899118 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:197 started Sep 27 04:18:30.901470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b4d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=726000000,duration_sec=400,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:30.902068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:30.902421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:197 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:32.900262 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:198 started Sep 27 04:18:32.902548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b4f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=727000000,duration_sec=402,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:32.903124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:32.903480 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:198 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:18:34.900848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:199 started Sep 27 04:18:34.903217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=727000000,duration_sec=404,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:34.903787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:34.904631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:199 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:18:36.902888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:200 started Sep 27 04:18:36.905826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b53,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=729000000,duration_sec=406,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:36.906398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:36.906749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:200 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:38.904667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:201 started Sep 27 04:18:38.907016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b55,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=731000000,duration_sec=408,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:38.907585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:38.907937 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:201 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:40.905369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:202 started Sep 27 04:18:40.911933 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b57,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=732000000,duration_sec=410,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:40.912524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:40.912900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:202 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:18:42.906608 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:203 started Sep 27 04:18:42.908877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b59,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=733000000,duration_sec=412,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:42.909441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:42.909832 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:203 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:18:44.907389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:204 started Sep 27 04:18:44.909771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=734000000,duration_sec=414,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:44.910342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:44.910689 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:204 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:18:46.908165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:205 started Sep 27 04:18:46.910538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b5d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=735000000,duration_sec=416,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:46.911102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:46.911448 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:205 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:18:48.909697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:206 started Sep 27 04:18:48.912084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=736000000,duration_sec=418,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:48.912671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:48.913045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:206 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:50.910364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:207 started Sep 27 04:18:50.913058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b61,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=737000000,duration_sec=420,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:50.913635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:50.914010 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:207 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:52.911279 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:208 started Sep 27 04:18:52.913537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=738000000,duration_sec=422,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:52.914131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:52.914479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:208 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:18:54.912011 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:209 started Sep 27 04:18:54.914695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b65,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=739000000,duration_sec=424,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:54.915266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:54.915641 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:209 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:18:56.913280 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:210 started Sep 27 04:18:56.915639 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=740000000,duration_sec=426,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:56.916204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:56.916552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:210 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:18:58.914743 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:211 started Sep 27 04:18:58.917141 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b69,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=741000000,duration_sec=428,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:18:58.917705 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:18:58.918092 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:211 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:00.916208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:212 started Sep 27 04:19:00.918655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b6b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=743000000,duration_sec=430,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:00.919228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:00.919580 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:212 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:02.917392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:213 started Sep 27 04:19:02.919683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b6d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=744000000,duration_sec=432,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:02.920247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:02.920593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:213 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:19:04.918196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:214 started Sep 27 04:19:04.920607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=745000000,duration_sec=434,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:04.921685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:04.922060 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:214 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:06.919049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:215 started Sep 27 04:19:06.921442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b71,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=746000000,duration_sec=436,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:06.922051 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:06.922402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:215 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:08.919827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:216 started Sep 27 04:19:08.922256 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b73,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=746000000,duration_sec=438,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:08.922823 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:08.923177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:216 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:10.920563 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:217 started Sep 27 04:19:10.923556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=748000000,duration_sec=440,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:10.924131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:10.924481 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:217 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:12.922078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:218 started Sep 27 04:19:12.924986 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=749000000,duration_sec=442,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:12.925538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:12.926467 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:218 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:14.923301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:219 started Sep 27 04:19:14.930019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=750000000,duration_sec=444,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:14.930669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:14.931111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:219 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:19:16.924536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:220 started Sep 27 04:19:16.927337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=751000000,duration_sec=446,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:16.927912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:16.928271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:220 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:18.925245 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:221 started Sep 27 04:19:18.928361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b7d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=752000000,duration_sec=448,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:18.928935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:18.929292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:221 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:20.926098 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:222 started Sep 27 04:19:20.928633 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b7f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=753000000,duration_sec=450,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:20.929192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:20.929569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:222 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:22.926893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:223 started Sep 27 04:19:22.929309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b81,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=753000000,duration_sec=452,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:22.929914 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:22.930259 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:223 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:24.928040 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:224 started Sep 27 04:19:24.930537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b83,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=755000000,duration_sec=454,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:24.931118 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:24.931476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:224 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:26.929056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:225 started Sep 27 04:19:26.931442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b85,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=756000000,duration_sec=456,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:26.931999 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:26.932345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:225 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:19:28.929916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:226 started Sep 27 04:19:28.932354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b87,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=757000000,duration_sec=458,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:28.932908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:28.933259 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:226 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:30.931093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:227 started Sep 27 04:19:30.934187 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b89,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=758000000,duration_sec=460,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:30.934752 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:30.935105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:227 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:32.931691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:228 started Sep 27 04:19:32.934135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b8b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=758000000,duration_sec=462,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:32.935026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:32.935392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:228 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:34.932538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:229 started Sep 27 04:19:34.935099 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b8d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=759000000,duration_sec=464,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:34.935661 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:34.936006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:229 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:36.933221 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:230 started Sep 27 04:19:36.935771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b8f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=760000000,duration_sec=466,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:36.936328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:36.936742 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:230 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:38.934809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:231 started Sep 27 04:19:38.938437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b91,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=762000000,duration_sec=468,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:38.939006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:38.939365 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:231 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:19:40.936113 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:232 started Sep 27 04:19:40.939150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b93,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=763000000,duration_sec=470,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:40.939707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:40.940057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:232 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:42.937474 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:233 started Sep 27 04:19:42.939925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b95,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=764000000,duration_sec=472,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:42.940492 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:42.940851 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:233 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:44.937862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:234 started Sep 27 04:19:44.940826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b97,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=764000000,duration_sec=474,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:44.941413 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:44.941799 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:234 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:46.939273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:235 started Sep 27 04:19:46.942090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=766000000,duration_sec=476,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:46.942659 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:46.943015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:235 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:48.940007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:236 started Sep 27 04:19:48.942557 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b9b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=767000000,duration_sec=478,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:48.943110 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:48.943456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:236 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:50.940942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:237 started Sep 27 04:19:50.950578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b9d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=768000000,duration_sec=480,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:50.950578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:50.950578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:237 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:52.942050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:238 started Sep 27 04:19:52.944798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22b9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=769000000,duration_sec=482,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:52.945378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:52.946094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:238 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:19:54.379755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:19:54Z,description='Default security group',id=a739030a-6e60-49f1-b474-2e81a8470511,is_default=True,name='default',project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',revision_number=1,rules=[SecurityGroupRule(283b54c7-e4c1-41f8-bbd0-5c875a7c037c),SecurityGroupRule(6e20e452-cb14-4a72-aaa6-86c1f8f5c345),SecurityGroupRule(76f16f17-ae08-4461-a629-0294d44f0448),SecurityGroupRule(c2c16423-d655-415a-8ef1-148d35820b20)],shared=False,stateful=True,updated_at=2022-09-27T04:19:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:54.380419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (a739030a-6e60-49f1-b474-2e81a8470511), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:54.384070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:54Z,description=,direction='egress',ethertype='IPv4',id=283b54c7-e4c1-41f8-bbd0-5c875a7c037c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a739030a-6e60-49f1-b474-2e81a8470511,updated_at=2022-09-27T04:19:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:54.384070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (283b54c7-e4c1-41f8-bbd0-5c875a7c037c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:54.384070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Security group rule updated ['a739030a-6e60-49f1-b474-2e81a8470511'] Sep 27 04:19:54.384363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:54Z,description=,direction='egress',ethertype='IPv6',id=6e20e452-cb14-4a72-aaa6-86c1f8f5c345,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a739030a-6e60-49f1-b474-2e81a8470511,updated_at=2022-09-27T04:19:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:54.384363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6e20e452-cb14-4a72-aaa6-86c1f8f5c345), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:54.384363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Security group rule updated ['a739030a-6e60-49f1-b474-2e81a8470511'] Sep 27 04:19:54.384565 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:54Z,description=,direction='ingress',ethertype='IPv6',id=76f16f17-ae08-4461-a629-0294d44f0448,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol=,remote_address_group_id=,remote_group_id=a739030a-6e60-49f1-b474-2e81a8470511,remote_ip_prefix=,revision_number=0,security_group_id=a739030a-6e60-49f1-b474-2e81a8470511,updated_at=2022-09-27T04:19:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:54.384868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (76f16f17-ae08-4461-a629-0294d44f0448), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:54.385363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Security group rule updated ['a739030a-6e60-49f1-b474-2e81a8470511'] Sep 27 04:19:54.386340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:54Z,description=,direction='ingress',ethertype='IPv4',id=c2c16423-d655-415a-8ef1-148d35820b20,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol=,remote_address_group_id=,remote_group_id=a739030a-6e60-49f1-b474-2e81a8470511,remote_ip_prefix=,revision_number=0,security_group_id=a739030a-6e60-49f1-b474-2e81a8470511,updated_at=2022-09-27T04:19:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:54.386701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c2c16423-d655-415a-8ef1-148d35820b20), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:54.387206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Security group rule updated ['a739030a-6e60-49f1-b474-2e81a8470511'] Sep 27 04:19:54.515884 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:19:54Z,description='',dns_domain=None,id=a72f6105-d258-45cb-a84d-18590bef93c2,mtu=1500,name='tempest-AttachVolumeTestJSON-764308454-network',project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(a72f6105-d258-45cb-a84d-18590bef93c2),segments=[NetworkSegment(a913cdfa-72ec-4cc3-8b5c-57a3fb6a0921)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:19:54Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:54.516538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (a72f6105-d258-45cb-a84d-18590bef93c2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-5b666f20-dc74-44b5-9441-50d377b65d3d admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network a72f6105-d258-45cb-a84d-18590bef93c2 with segmentation id not found. Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:19:54.598167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:19:54.599180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:19:54.599180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:19:54.599180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:19:54.599180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network a72f6105-d258-45cb-a84d-18590bef93c2 with segmentation id not found. Sep 27 04:19:54.599180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:19:54.891621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea3a3092-ea62-4892-adc2-08de0c21f8af admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ef519160-4245-446d-93ca-25a9a956b1ff)],cidr=172.20.0.0/28,created_at=2022-09-27T04:19:54Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=8e579293-c2b5-4786-882a-437ca24df95d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeTestJSON-764308454-subnet',network_id=a72f6105-d258-45cb-a84d-18590bef93c2,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:19:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:54.892194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea3a3092-ea62-4892-adc2-08de0c21f8af admin admin] Publish callbacks [] for Subnet (8e579293-c2b5-4786-882a-437ca24df95d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:54.943574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:239 started Sep 27 04:19:54.946925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ba1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=770000000,duration_sec=484,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:54.947758 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:54.948291 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:239 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:19:55.590565 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9abfb10d-2cef-4e72-8f70-82b2a39bc4cc None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:19:55Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-a72f6105-d258-45cb-a84d-18590bef93c2',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=15fb290d-5c6d-48ee-8bbf-dacd88fa8666,mac_address=fa:16:3e:e2:4a:53,name='',network_id=a72f6105-d258-45cb-a84d-18590bef93c2,numa_affinity_policy=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(15fb290d-5c6d-48ee-8bbf-dacd88fa8666),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:55.594697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9abfb10d-2cef-4e72-8f70-82b2a39bc4cc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (15fb290d-5c6d-48ee-8bbf-dacd88fa8666), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:55.948718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:19:55Z,description='Default security group',id=6292e5d4-a4a9-48a7-955f-6a9e34544572,is_default=True,name='default',project_id='7914c4b5217f411f807854ccb07e0365',revision_number=1,rules=[SecurityGroupRule(14d50b75-ed41-4925-b5a5-00a15cd4f0bd),SecurityGroupRule(23d5db83-309b-4b0d-80ce-9c3a62b15224),SecurityGroupRule(434b229b-622f-4b47-95c3-23f1c62ecef6),SecurityGroupRule(f4fc6e30-83b9-4013-8fee-6b8714f4faf1)],shared=False,stateful=True,updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:55.950870 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (6292e5d4-a4a9-48a7-955f-6a9e34544572), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:55.960571 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:55Z,description=,direction='ingress',ethertype='IPv6',id=14d50b75-ed41-4925-b5a5-00a15cd4f0bd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7914c4b5217f411f807854ccb07e0365',protocol=,remote_address_group_id=,remote_group_id=6292e5d4-a4a9-48a7-955f-6a9e34544572,remote_ip_prefix=,revision_number=0,security_group_id=6292e5d4-a4a9-48a7-955f-6a9e34544572,updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:55.960981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (14d50b75-ed41-4925-b5a5-00a15cd4f0bd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:55.961336 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Security group rule updated ['6292e5d4-a4a9-48a7-955f-6a9e34544572'] Sep 27 04:19:55.965363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:55Z,description=,direction='egress',ethertype='IPv6',id=23d5db83-309b-4b0d-80ce-9c3a62b15224,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7914c4b5217f411f807854ccb07e0365',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6292e5d4-a4a9-48a7-955f-6a9e34544572,updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:55.965760 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (23d5db83-309b-4b0d-80ce-9c3a62b15224), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:55.966155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Security group rule updated ['6292e5d4-a4a9-48a7-955f-6a9e34544572'] Sep 27 04:19:55.966846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:55Z,description=,direction='ingress',ethertype='IPv4',id=434b229b-622f-4b47-95c3-23f1c62ecef6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7914c4b5217f411f807854ccb07e0365',protocol=,remote_address_group_id=,remote_group_id=6292e5d4-a4a9-48a7-955f-6a9e34544572,remote_ip_prefix=,revision_number=0,security_group_id=6292e5d4-a4a9-48a7-955f-6a9e34544572,updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:55.967207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (434b229b-622f-4b47-95c3-23f1c62ecef6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:55.967544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Security group rule updated ['6292e5d4-a4a9-48a7-955f-6a9e34544572'] Sep 27 04:19:55.968366 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:55Z,description=,direction='egress',ethertype='IPv4',id=f4fc6e30-83b9-4013-8fee-6b8714f4faf1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7914c4b5217f411f807854ccb07e0365',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6292e5d4-a4a9-48a7-955f-6a9e34544572,updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:55.968919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f4fc6e30-83b9-4013-8fee-6b8714f4faf1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:55.969419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Security group rule updated ['6292e5d4-a4a9-48a7-955f-6a9e34544572'] Sep 27 04:19:55.990053 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9abfb10d-2cef-4e72-8f70-82b2a39bc4cc None None] Resource Port 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=15fb290d-5c6d-48ee-8bbf-dacd88fa8666,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=15fb290d-5c6d-48ee-8bbf-dacd88fa8666,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=15fb290d-5c6d-48ee-8bbf-dacd88fa8666,segment=NetworkSegment(a913cdfa-72ec-4cc3-8b5c-57a3fb6a0921),segment_id=a913cdfa-72ec-4cc3-8b5c-57a3fb6a0921)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:19:55.991383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9abfb10d-2cef-4e72-8f70-82b2a39bc4cc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (15fb290d-5c6d-48ee-8bbf-dacd88fa8666), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:56.172806 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:19:55Z,description='Default security group',id=131000a9-818e-409d-92c3-5daf5702321e,is_default=True,name='default',project_id='312fa89a4d9b43c5919b7bad5411002a',revision_number=1,rules=[SecurityGroupRule(172641b8-7dde-411f-9c5c-5d710392128a),SecurityGroupRule(69ee43ac-7da0-4181-8bda-355c7cb19d76),SecurityGroupRule(83862057-7ebd-436e-a9be-b370a96930df),SecurityGroupRule(98ad58dc-d428-43bd-9212-cbca1788398d)],shared=False,stateful=True,updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:56.173351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (131000a9-818e-409d-92c3-5daf5702321e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:56.174125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:55Z,description=,direction='egress',ethertype='IPv4',id=172641b8-7dde-411f-9c5c-5d710392128a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=131000a9-818e-409d-92c3-5daf5702321e,updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:56.174664 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (172641b8-7dde-411f-9c5c-5d710392128a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:56.175254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Security group rule updated ['131000a9-818e-409d-92c3-5daf5702321e'] Sep 27 04:19:56.176165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:55Z,description=,direction='egress',ethertype='IPv6',id=69ee43ac-7da0-4181-8bda-355c7cb19d76,normalized_cidr=None,port_range_max=,port_range_min=,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=131000a9-818e-409d-92c3-5daf5702321e,updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:56.176761 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (69ee43ac-7da0-4181-8bda-355c7cb19d76), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:56.177321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Security group rule updated ['131000a9-818e-409d-92c3-5daf5702321e'] Sep 27 04:19:56.178232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:55Z,description=,direction='ingress',ethertype='IPv4',id=83862057-7ebd-436e-a9be-b370a96930df,normalized_cidr=None,port_range_max=,port_range_min=,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol=,remote_address_group_id=,remote_group_id=131000a9-818e-409d-92c3-5daf5702321e,remote_ip_prefix=,revision_number=0,security_group_id=131000a9-818e-409d-92c3-5daf5702321e,updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:56.178830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (83862057-7ebd-436e-a9be-b370a96930df), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:56.179395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Security group rule updated ['131000a9-818e-409d-92c3-5daf5702321e'] Sep 27 04:19:56.181651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:19:55Z,description=,direction='ingress',ethertype='IPv6',id=98ad58dc-d428-43bd-9212-cbca1788398d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol=,remote_address_group_id=,remote_group_id=131000a9-818e-409d-92c3-5daf5702321e,remote_ip_prefix=,revision_number=0,security_group_id=131000a9-818e-409d-92c3-5daf5702321e,updated_at=2022-09-27T04:19:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:56.182303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (98ad58dc-d428-43bd-9212-cbca1788398d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:56.183038 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Security group rule updated ['131000a9-818e-409d-92c3-5daf5702321e'] Sep 27 04:19:56.229485 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5c8dc72e-bec4-4d34-9eb8-ba61334e3a48","insert","tap15fb290d-5c",["set",[]],["map",[["attached-mac","fa:16:3e:e2:4a:53"],["iface-id","15fb290d-5c6d-48ee-8bbf-dacd88fa8666"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:19:56.309814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5c8dc72e-bec4-4d34-9eb8-ba61334e3a48","old",null,["set",[]],null],["","new","tap15fb290d-5c",6,["map",[["attached-mac","fa:16:3e:e2:4a:53"],["iface-id","15fb290d-5c6d-48ee-8bbf-dacd88fa8666"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:19:56.490662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:19:55Z,description='',dns_domain=None,id=90468030-e15f-4d68-bea3-d020393e070f,mtu=1500,name='tempest-DeleteServersTestJSON-1362071837-network',project_id='7914c4b5217f411f807854ccb07e0365',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(90468030-e15f-4d68-bea3-d020393e070f),segments=[NetworkSegment(140b4dbd-c7b9-40d2-9281-c4e4b44aa6c5)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:19:55Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:56.492015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (90468030-e15f-4d68-bea3-d020393e070f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-929d4ea0-a9db-4391-bae2-a23e46acc119 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 90468030-e15f-4d68-bea3-d020393e070f with segmentation id not found. Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:19:56.677797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:19:56.679067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:19:56.679067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:19:56.679067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:19:56.679067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 90468030-e15f-4d68-bea3-d020393e070f with segmentation id not found. Sep 27 04:19:56.679067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:19:56.826062 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0732ffcd-c1cd-4db5-8d85-7f4879695ed6 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(fe8d2dcc-6188-4532-a46c-2a8cce98e0e1)],cidr=172.20.0.0/28,created_at=2022-09-27T04:19:56Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=ef556055-3d79-4e00-91ba-4215c47f3d3a,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-DeleteServersTestJSON-1362071837-subnet',network_id=90468030-e15f-4d68-bea3-d020393e070f,project_id='7914c4b5217f411f807854ccb07e0365',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:19:56Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:56.828150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0732ffcd-c1cd-4db5-8d85-7f4879695ed6 admin admin] Publish callbacks [] for Subnet (ef556055-3d79-4e00-91ba-4215c47f3d3a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:56.840978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4e9f233b-868b-4a85-9f9f-4b9d10c2be1a admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:19:55Z,data_plane_status=None,description='',device_id='87ac5442-42b0-4418-857a-78da77f545b5',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b46b0326-166d-45b8-8db2-cac369fbf847,mac_address=fa:16:3e:e9:78:58,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b46b0326-166d-45b8-8db2-cac369fbf847),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:19:56Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:56.841728 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4e9f233b-868b-4a85-9f9f-4b9d10c2be1a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b46b0326-166d-45b8-8db2-cac369fbf847), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:56.944687 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:240 started Sep 27 04:19:56.948643 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ba3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=772000000,duration_sec=486,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:56.949431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:56.950206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:240 - starting polling. Elapsed:0.006 Sep 27 04:19:56.951767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:56.954403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:240 - port information retrieved. Elapsed:0.010 Sep 27 04:19:56.954823 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'15fb290d-5c6d-48ee-8bbf-dacd88fa8666'}, 'removed': set(), 'updated': {'15fb290d-5c6d-48ee-8bbf-dacd88fa8666'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:19:56.956460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-a72f6105-d258-45cb-a84d-18590bef93c2', 'network_id': 'a72f6105-d258-45cb-a84d-18590bef93c2', 'port_id': '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', 'mac_address': 'fa:16:3e:e2:4a:53', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8e579293-c2b5-4786-882a-437ca24df95d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:19:56.959414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:19:56.961136 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 updated. Details: {'device': '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-a72f6105-d258-45cb-a84d-18590bef93c2', 'network_id': 'a72f6105-d258-45cb-a84d-18590bef93c2', 'port_id': '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', 'mac_address': 'fa:16:3e:e2:4a:53', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8e579293-c2b5-4786-882a-437ca24df95d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:19:56.961512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 4 as local vlan for net-id=a72f6105-d258-45cb-a84d-18590bef93c2, seg-id=113 Sep 27 04:19:56.967998 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32ea1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4209), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:56.977946 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22ba5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4100)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4209}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:56.981035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap15fb290d-5c, col_values=(('tag', 4),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:19:56.982900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap15fb290d-5c, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:19:56.983418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap15fb290d-5c, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:19:56.995577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap15fb290d-5c, col_values=(('other_config', {'net_uuid': 'a72f6105-d258-45cb-a84d-18590bef93c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '113'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:19:57.011555 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22ba7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:57.014097 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:240 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.057 Sep 27 04:19:57.015401 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:19:57.015732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'15fb290d-5c6d-48ee-8bbf-dacd88fa8666'} Sep 27 04:19:57.019277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:19:57.020696 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:19:57.026273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:19:57.138530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f0eba-c15c-4eb7-9744-4d9585820f60]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:19:57.140207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:240 - agent port security group processed in 0.184 Sep 27 04:19:57.140883 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:19:57.396221 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:19:56Z,description='',dns_domain=None,id=50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6,mtu=1500,name='tempest-AttachVolumeShelveTestJSON-185060981-network',project_id='312fa89a4d9b43c5919b7bad5411002a',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6),segments=[NetworkSegment(188f0649-0d82-4591-a8be-8000cf940ed2)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:19:56Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:57.397285 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:58.236560 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-07a58ce7-5bf6-4417-9bf9-f7e13ffd814c admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(5136eecc-d02a-44b1-b620-e3d9c8d94bb7)],cidr=172.20.0.0/28,created_at=2022-09-27T04:19:57Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=7fbc1344-d37e-4e3c-8ea2-baced031ac4e,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeShelveTestJSON-185060981-subnet',network_id=50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6,project_id='312fa89a4d9b43c5919b7bad5411002a',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:19:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:58.237310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-07a58ce7-5bf6-4417-9bf9-f7e13ffd814c admin admin] Publish callbacks [] for Subnet (7fbc1344-d37e-4e3c-8ea2-baced031ac4e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-ca804a0e-bc3e-46bc-86c3-27d0c18f559b admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6 with segmentation id not found. Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:19:58.525050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:19:58.526266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:19:58.526266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:19:58.526266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:19:58.526266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6 with segmentation id not found. Sep 27 04:19:58.526266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:19:59.189424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-babe98c7-9eb3-43fb-a962-573a19bb1f02 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:19:58Z,data_plane_status=None,description='',device_id='1570ff6f-8fc2-4463-9e5e-3ed7a777c891',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0013e2cc-d36e-4a05-a5c8-47024496dd16,mac_address=fa:16:3e:b5:4b:b7,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0013e2cc-d36e-4a05-a5c8-47024496dd16),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:19:58Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:59.189919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-babe98c7-9eb3-43fb-a962-573a19bb1f02 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0013e2cc-d36e-4a05-a5c8-47024496dd16), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:59.206702 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['15fb290d-5c6d-48ee-8bbf-dacd88fa8666'] and devices down [] completed. Sep 27 04:19:59.207737 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:240 - ports processed. Elapsed:2.263 Sep 27 04:19:59.208803 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:240 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:2.264 Sep 27 04:19:59.210654 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Loop iteration exceeded interval (2 vs. 2.264151096343994)! {{(pid=107232) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 27 04:19:59.211488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:241 started Sep 27 04:19:59.215170 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ba9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=39000000,duration_sec=489,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:19:59.216152 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:19:59.216979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:241 - starting polling. Elapsed:0.006 Sep 27 04:19:59.219820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:59.224982 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:241 - port information retrieved. Elapsed:0.012 Sep 27 04:19:59.227002 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:241 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 27 04:19:59.403153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3737e6d7-b6e2-48b2-a8e9-91f0233ea28f None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:19:57Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-90468030-e15f-4d68-bea3-d020393e070f',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2d5f14d8-97ae-45cd-98a4-2634bc19c645,mac_address=fa:16:3e:c7:03:4f,name='',network_id=90468030-e15f-4d68-bea3-d020393e070f,numa_affinity_policy=,project_id='7914c4b5217f411f807854ccb07e0365',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2d5f14d8-97ae-45cd-98a4-2634bc19c645),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:19:58Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:19:59.404268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3737e6d7-b6e2-48b2-a8e9-91f0233ea28f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (2d5f14d8-97ae-45cd-98a4-2634bc19c645), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:19:59.594290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:19:59.594730 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (15fb290d-5c6d-48ee-8bbf-dacd88fa8666), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:00.205396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3737e6d7-b6e2-48b2-a8e9-91f0233ea28f None None] Resource Port 2d5f14d8-97ae-45cd-98a4-2634bc19c645 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=2d5f14d8-97ae-45cd-98a4-2634bc19c645,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=2d5f14d8-97ae-45cd-98a4-2634bc19c645,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=2d5f14d8-97ae-45cd-98a4-2634bc19c645,segment=NetworkSegment(140b4dbd-c7b9-40d2-9281-c4e4b44aa6c5),segment_id=140b4dbd-c7b9-40d2-9281-c4e4b44aa6c5)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:00.205839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3737e6d7-b6e2-48b2-a8e9-91f0233ea28f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (2d5f14d8-97ae-45cd-98a4-2634bc19c645), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:00.292160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["150f4339-63d5-4c56-b6d7-87c730631b53","insert","tap2d5f14d8-97",["set",[]],["map",[["attached-mac","fa:16:3e:c7:03:4f"],["iface-id","2d5f14d8-97ae-45cd-98a4-2634bc19c645"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:00.296375 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["150f4339-63d5-4c56-b6d7-87c730631b53","old",null,["set",[]],null],["","new","tap2d5f14d8-97",7,["map",[["attached-mac","fa:16:3e:c7:03:4f"],["iface-id","2d5f14d8-97ae-45cd-98a4-2634bc19c645"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:00.618900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1ee63200-d683-451d-8969-8f10386e6747 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:19:58Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=133717b2-0788-457d-9fba-bcfb1664cf21,mac_address=fa:16:3e:5c:c8:9e,name='',network_id=50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6,numa_affinity_policy=,project_id='312fa89a4d9b43c5919b7bad5411002a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(133717b2-0788-457d-9fba-bcfb1664cf21),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:20:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:00.620036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1ee63200-d683-451d-8969-8f10386e6747 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (133717b2-0788-457d-9fba-bcfb1664cf21), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:00.713180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-46f1b09b-31db-4822-8d34-b87c2ae0a8d9 None None] Resource Port b46b0326-166d-45b8-8db2-cac369fbf847 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=b46b0326-166d-45b8-8db2-cac369fbf847,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=b46b0326-166d-45b8-8db2-cac369fbf847,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:00.713556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-46f1b09b-31db-4822-8d34-b87c2ae0a8d9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b46b0326-166d-45b8-8db2-cac369fbf847), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:01.214491 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:242 started Sep 27 04:20:01.219440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=42000000,duration_sec=491,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:01.220463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:01.221834 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:242 - starting polling. Elapsed:0.007 Sep 27 04:20:01.229718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:01.237991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:242 - port information retrieved. Elapsed:0.020 Sep 27 04:20:01.238569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645'}, 'removed': set(), 'updated': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:20:01.241713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-90468030-e15f-4d68-bea3-d020393e070f', 'network_id': '90468030-e15f-4d68-bea3-d020393e070f', 'port_id': '2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'mac_address': 'fa:16:3e:c7:03:4f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ef556055-3d79-4e00-91ba-4215c47f3d3a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:01.247588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-a72f6105-d258-45cb-a84d-18590bef93c2', 'network_id': 'a72f6105-d258-45cb-a84d-18590bef93c2', 'port_id': '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', 'mac_address': 'fa:16:3e:e2:4a:53', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8e579293-c2b5-4786-882a-437ca24df95d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:01.256840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 2d5f14d8-97ae-45cd-98a4-2634bc19c645 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:01.257280 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 2d5f14d8-97ae-45cd-98a4-2634bc19c645 updated. Details: {'device': '2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-90468030-e15f-4d68-bea3-d020393e070f', 'network_id': '90468030-e15f-4d68-bea3-d020393e070f', 'port_id': '2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'mac_address': 'fa:16:3e:c7:03:4f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ef556055-3d79-4e00-91ba-4215c47f3d3a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:20:01.265831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 5 as local vlan for net-id=90468030-e15f-4d68-bea3-d020393e070f, seg-id=141 Sep 27 04:20:01.282378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6cfe6f7f-904a-4a4b-888a-308260ac3936 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:00Z,data_plane_status=None,description='',device_id='484d1f09-a6b1-4259-a367-00e5d24c5c04',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=72256acd-5a77-4ad3-be5d-043dcec0575b,mac_address=fa:16:3e:2e:dc:79,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(72256acd-5a77-4ad3-be5d-043dcec0575b),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:20:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:01.284529 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6cfe6f7f-904a-4a4b-888a-308260ac3936 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (72256acd-5a77-4ad3-be5d-043dcec0575b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:01.333238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32ea3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4237), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:01.352435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22bad,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4101)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4237}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:01.362101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d5f14d8-97, col_values=(('tag', 5),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:01.365654 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap2d5f14d8-97, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:01.366319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap2d5f14d8-97, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:01.401043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d5f14d8-97, col_values=(('other_config', {'net_uuid': '90468030-e15f-4d68-bea3-d020393e070f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '141'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:01.433164 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22baf,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:01.436325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:01.437124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 updated. Details: {'device': '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-a72f6105-d258-45cb-a84d-18590bef93c2', 'network_id': 'a72f6105-d258-45cb-a84d-18590bef93c2', 'port_id': '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', 'mac_address': 'fa:16:3e:e2:4a:53', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8e579293-c2b5-4786-882a-437ca24df95d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Sep 27 04:20:01.438905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap15fb290d-5c, col_values=(('tag', 4),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:01.439535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap15fb290d-5c, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:01.441766 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap15fb290d-5c, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:01.442414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:01.446669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap15fb290d-5c, col_values=(('other_config', {'net_uuid': 'a72f6105-d258-45cb-a84d-18590bef93c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '113', 'tag': '4'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:01.450561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:01.458728 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bb1,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:01.460967 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:242 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 6 devices currently available. Time elapsed: 0.219 Sep 27 04:20:01.463830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:20:01.464233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'2d5f14d8-97ae-45cd-98a4-2634bc19c645'} Sep 27 04:20:01.466649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:01.467591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:01.484310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:01.566599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d2fbb151-4561-491c-8813-c018f5eb45b9","insert","tap133717b2-07",["set",[]],["map",[["attached-mac","fa:16:3e:5c:c8:9e"],["iface-id","133717b2-0788-457d-9fba-bcfb1664cf21"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:01.607251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d2fbb151-4561-491c-8813-c018f5eb45b9","old",null,["set",[]],null],["","new","tap133717b2-07",8,["map",[["attached-mac","fa:16:3e:5c:c8:9e"],["iface-id","133717b2-0788-457d-9fba-bcfb1664cf21"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:01.658090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-46f1b09b-31db-4822-8d34-b87c2ae0a8d9 None None] Resource Port b46b0326-166d-45b8-8db2-cac369fbf847 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=b46b0326-166d-45b8-8db2-cac369fbf847,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=b46b0326-166d-45b8-8db2-cac369fbf847,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=b46b0326-166d-45b8-8db2-cac369fbf847,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:01.658760 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-46f1b09b-31db-4822-8d34-b87c2ae0a8d9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b46b0326-166d-45b8-8db2-cac369fbf847), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:01.673422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed8549f-3691-47d4-82b6-2834c7780b60]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:01.674941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:20:01.675334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:20:01.686229 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:01.690118 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:01.699573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:01.845556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a3f028-d325-4100-9581-ee64364855ed]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:01.848492 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:242 - agent port security group processed in 0.606 Sep 27 04:20:01.849485 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 2d5f14d8-97ae-45cd-98a4-2634bc19c645 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:01.850009 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:02.568368 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a6a78d34-90ed-4e05-99eb-6adc9872bf66","insert","qg-b46b0326-16",["set",[]],["map",[["attached-mac","fa:16:3e:e9:78:58"],["iface-id","b46b0326-166d-45b8-8db2-cac369fbf847"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:02.605046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a6a78d34-90ed-4e05-99eb-6adc9872bf66","old",null,["set",[]],null],["","new","qg-b46b0326-16",9,["map",[["attached-mac","fa:16:3e:e9:78:58"],["iface-id","b46b0326-166d-45b8-8db2-cac369fbf847"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:02.648954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d6c10a6c-a4e8-4daa-a6c5-0b0b82ffda18 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:00Z,data_plane_status=None,description='',device_id='87ac5442-42b0-4418-857a-78da77f545b5',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3644c780-ef74-4954-a68a-6cc2eadf34ce,mac_address=fa:16:3e:d1:b9:71,name='',network_id=a72f6105-d258-45cb-a84d-18590bef93c2,numa_affinity_policy=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3644c780-ef74-4954-a68a-6cc2eadf34ce),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:20:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:02.649607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d6c10a6c-a4e8-4daa-a6c5-0b0b82ffda18 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (3644c780-ef74-4954-a68a-6cc2eadf34ce), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:02.883409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1ee63200-d683-451d-8969-8f10386e6747 None None] Resource Port 133717b2-0788-457d-9fba-bcfb1664cf21 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=133717b2-0788-457d-9fba-bcfb1664cf21,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=133717b2-0788-457d-9fba-bcfb1664cf21,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=133717b2-0788-457d-9fba-bcfb1664cf21,segment=NetworkSegment(188f0649-0d82-4591-a8be-8000cf940ed2),segment_id=188f0649-0d82-4591-a8be-8000cf940ed2)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:02.884009 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1ee63200-d683-451d-8969-8f10386e6747 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (133717b2-0788-457d-9fba-bcfb1664cf21), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:03.658818 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-10b5c486-717c-4d27-b306-0bdbe601206d admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:02Z,data_plane_status=None,description='',device_id='1570ff6f-8fc2-4463-9e5e-3ed7a777c891',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5c3fe5c2-e2df-4f03-bd8f-40af037c4b87,mac_address=fa:16:3e:ad:cb:5d,name='',network_id=90468030-e15f-4d68-bea3-d020393e070f,numa_affinity_policy=,project_id='7914c4b5217f411f807854ccb07e0365',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5c3fe5c2-e2df-4f03-bd8f-40af037c4b87),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:20:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:03.660993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-10b5c486-717c-4d27-b306-0bdbe601206d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (5c3fe5c2-e2df-4f03-bd8f-40af037c4b87), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:04.015738 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d6c10a6c-a4e8-4daa-a6c5-0b0b82ffda18 admin admin] Received resource Port update without any changes: 3644c780-ef74-4954-a68a-6cc2eadf34ce {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:20:04.701966 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-10b5c486-717c-4d27-b306-0bdbe601206d admin admin] Received resource Port update without any changes: 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:20:04.752827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9e72aa6d-1138-4a07-875b-779c2b12826d None None] Resource Port 2d5f14d8-97ae-45cd-98a4-2634bc19c645 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:04.753418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9e72aa6d-1138-4a07-875b-779c2b12826d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (2d5f14d8-97ae-45cd-98a4-2634bc19c645), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:04.838231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e6ea1341-497b-40e6-9292-6ebb20edf71b None None] Resource Port 0013e2cc-d36e-4a05-a5c8-47024496dd16 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0013e2cc-d36e-4a05-a5c8-47024496dd16,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=0013e2cc-d36e-4a05-a5c8-47024496dd16,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:04.838738 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e6ea1341-497b-40e6-9292-6ebb20edf71b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0013e2cc-d36e-4a05-a5c8-47024496dd16), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:05.657420 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e6ea1341-497b-40e6-9292-6ebb20edf71b None None] Resource Port 0013e2cc-d36e-4a05-a5c8-47024496dd16 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=0013e2cc-d36e-4a05-a5c8-47024496dd16,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=0013e2cc-d36e-4a05-a5c8-47024496dd16,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=0013e2cc-d36e-4a05-a5c8-47024496dd16,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:05.658568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e6ea1341-497b-40e6-9292-6ebb20edf71b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0013e2cc-d36e-4a05-a5c8-47024496dd16), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:05.897236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1de493c5-dfa4-49d4-aec5-1ead56681844 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:05Z,description='tempest-description--1985542786',id=62743add-abd0-40c3-a1bc-b77cc5f58cd6,is_default=False,name='tempest-securitygroup--331391197',project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',revision_number=1,rules=[SecurityGroupRule(0f2dffd0-f8a5-4d8e-9961-09a1f8e20ccf),SecurityGroupRule(b26cdee8-16b3-4b4d-8cc1-2e793e4dff05)],shared=False,stateful=True,updated_at=2022-09-27T04:20:05Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:05.898341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1de493c5-dfa4-49d4-aec5-1ead56681844 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (62743add-abd0-40c3-a1bc-b77cc5f58cd6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:05.899593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1de493c5-dfa4-49d4-aec5-1ead56681844 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:05Z,description=,direction='egress',ethertype='IPv6',id=0f2dffd0-f8a5-4d8e-9961-09a1f8e20ccf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=62743add-abd0-40c3-a1bc-b77cc5f58cd6,updated_at=2022-09-27T04:20:05Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:05.900217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1de493c5-dfa4-49d4-aec5-1ead56681844 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0f2dffd0-f8a5-4d8e-9961-09a1f8e20ccf), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:05.900856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1de493c5-dfa4-49d4-aec5-1ead56681844 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['62743add-abd0-40c3-a1bc-b77cc5f58cd6'] Sep 27 04:20:05.902439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1de493c5-dfa4-49d4-aec5-1ead56681844 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:05Z,description=,direction='egress',ethertype='IPv4',id=b26cdee8-16b3-4b4d-8cc1-2e793e4dff05,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=62743add-abd0-40c3-a1bc-b77cc5f58cd6,updated_at=2022-09-27T04:20:05Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:05.902982 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1de493c5-dfa4-49d4-aec5-1ead56681844 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b26cdee8-16b3-4b4d-8cc1-2e793e4dff05), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:05.903898 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1de493c5-dfa4-49d4-aec5-1ead56681844 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['62743add-abd0-40c3-a1bc-b77cc5f58cd6'] Sep 27 04:20:06.454352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-867a9ab0-355c-4f19-9d48-034051438770 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:06Z,description='',direction='ingress',ethertype='IPv4',id=2e359b6a-a9dc-400c-be5e-552284a73496,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=62743add-abd0-40c3-a1bc-b77cc5f58cd6,updated_at=2022-09-27T04:20:06Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:06.455886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-867a9ab0-355c-4f19-9d48-034051438770 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2e359b6a-a9dc-400c-be5e-552284a73496), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:06.456265 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-867a9ab0-355c-4f19-9d48-034051438770 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['62743add-abd0-40c3-a1bc-b77cc5f58cd6'] Sep 27 04:20:06.808185 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f6202637-af0b-4498-bf4b-2a3fb5f15217 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:06Z,description='',direction='ingress',ethertype='IPv4',id=e07b7bea-2d17-4e16-b75b-ca2c8a8d0a5f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=62743add-abd0-40c3-a1bc-b77cc5f58cd6,updated_at=2022-09-27T04:20:06Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:06.809269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f6202637-af0b-4498-bf4b-2a3fb5f15217 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e07b7bea-2d17-4e16-b75b-ca2c8a8d0a5f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:06.809855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f6202637-af0b-4498-bf4b-2a3fb5f15217 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['62743add-abd0-40c3-a1bc-b77cc5f58cd6'] Sep 27 04:20:06.894459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6faae91c-994b-4d58-9a92-0373d4ded845 None None] Resource Port 3644c780-ef74-4954-a68a-6cc2eadf34ce updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=3644c780-ef74-4954-a68a-6cc2eadf34ce,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=3644c780-ef74-4954-a68a-6cc2eadf34ce,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:06.895385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6faae91c-994b-4d58-9a92-0373d4ded845 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (3644c780-ef74-4954-a68a-6cc2eadf34ce), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:06.985109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['2d5f14d8-97ae-45cd-98a4-2634bc19c645', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666'] and devices down [] completed. Sep 27 04:20:06.985640 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:242 - ports processed. Elapsed:5.771 Sep 27 04:20:06.986548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:242 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:5.772 Sep 27 04:20:06.987410 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Loop iteration exceeded interval (2 vs. 5.772207260131836)! {{(pid=107232) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 27 04:20:06.987805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:243 started Sep 27 04:20:06.990887 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bb3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=815000000,duration_sec=496,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:06.991656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:06.992282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:243 - starting polling. Elapsed:0.005 Sep 27 04:20:06.994025 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:07.002892 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:243 - port information retrieved. Elapsed:0.015 Sep 27 04:20:07.004331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '133717b2-0788-457d-9fba-bcfb1664cf21', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'133717b2-0788-457d-9fba-bcfb1664cf21', 'b46b0326-166d-45b8-8db2-cac369fbf847'}, 'removed': set(), 'updated': {'133717b2-0788-457d-9fba-bcfb1664cf21', '2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'b46b0326-166d-45b8-8db2-cac369fbf847'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:20:07.006108 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-90468030-e15f-4d68-bea3-d020393e070f', 'network_id': '90468030-e15f-4d68-bea3-d020393e070f', 'port_id': '2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'mac_address': 'fa:16:3e:c7:03:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ef556055-3d79-4e00-91ba-4215c47f3d3a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:07.016240 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '133717b2-0788-457d-9fba-bcfb1664cf21', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'network_id': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'port_id': '133717b2-0788-457d-9fba-bcfb1664cf21', 'mac_address': 'fa:16:3e:5c:c8:9e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7fbc1344-d37e-4e3c-8ea2-baced031ac4e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:07.018339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'b46b0326-166d-45b8-8db2-cac369fbf847', 'device_id': '87ac5442-42b0-4418-857a-78da77f545b5', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'b46b0326-166d-45b8-8db2-cac369fbf847', 'mac_address': 'fa:16:3e:e9:78:58', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.71'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:07.020336 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 2d5f14d8-97ae-45cd-98a4-2634bc19c645 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:07.029484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 2d5f14d8-97ae-45cd-98a4-2634bc19c645 updated. Details: {'device': '2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-90468030-e15f-4d68-bea3-d020393e070f', 'network_id': '90468030-e15f-4d68-bea3-d020393e070f', 'port_id': '2d5f14d8-97ae-45cd-98a4-2634bc19c645', 'mac_address': 'fa:16:3e:c7:03:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ef556055-3d79-4e00-91ba-4215c47f3d3a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Sep 27 04:20:07.037504 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d5f14d8-97, col_values=(('tag', 5),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.037971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap2d5f14d8-97, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.038477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap2d5f14d8-97, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.039035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:07.049276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d5f14d8-97, col_values=(('other_config', {'net_uuid': '90468030-e15f-4d68-bea3-d020393e070f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '141', 'tag': '5'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.051996 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:07.072360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bb5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:07.073995 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 133717b2-0788-457d-9fba-bcfb1664cf21 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:07.074359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 133717b2-0788-457d-9fba-bcfb1664cf21 updated. Details: {'device': '133717b2-0788-457d-9fba-bcfb1664cf21', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'network_id': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'port_id': '133717b2-0788-457d-9fba-bcfb1664cf21', 'mac_address': 'fa:16:3e:5c:c8:9e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7fbc1344-d37e-4e3c-8ea2-baced031ac4e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:20:07.074707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 6 as local vlan for net-id=50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6, seg-id=124 Sep 27 04:20:07.087615 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32ea5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4220), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:07.106277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22bb7,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4102)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4220}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:07.113789 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap133717b2-07, col_values=(('tag', 6),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.114565 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap133717b2-07, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.115047 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap133717b2-07, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.132689 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap133717b2-07, col_values=(('other_config', {'net_uuid': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '124'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.182211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bb9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:07.182211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: b46b0326-166d-45b8-8db2-cac369fbf847 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:07.182403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b46b0326-166d-45b8-8db2-cac369fbf847 updated. Details: {'device': 'b46b0326-166d-45b8-8db2-cac369fbf847', 'device_id': '87ac5442-42b0-4418-857a-78da77f545b5', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'b46b0326-166d-45b8-8db2-cac369fbf847', 'mac_address': 'fa:16:3e:e9:78:58', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.71'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:20:07.182403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b46b0326-16, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.182403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-b46b0326-16, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.183037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-b46b0326-16, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.194512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b46b0326-16, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:07.219506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bbb,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:07.219965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:243 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 8 devices currently available. Time elapsed: 0.215 Sep 27 04:20:07.220564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 2 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:20:07.221079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'133717b2-0788-457d-9fba-bcfb1664cf21', 'b46b0326-166d-45b8-8db2-cac369fbf847'} Sep 27 04:20:07.223093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:07.229330 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:07.233142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:07.328121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f36cb5-f286-4c2f-8261-efc55370a535]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:07.329514 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:20:07.330254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:20:07.334749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:07.335262 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:07.340387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:07.424152 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["55a69478-0318-46fc-91ab-b23c817eb161","insert","qr-5c3fe5c2-e2",["set",[]],["map",[["attached-mac","fa:16:3e:ad:cb:5d"],["iface-id","5c3fe5c2-e2df-4f03-bd8f-40af037c4b87"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:07.434871 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["55a69478-0318-46fc-91ab-b23c817eb161","old",null,["set",[]],null],["","new","qr-5c3fe5c2-e2",10,["map",[["attached-mac","fa:16:3e:ad:cb:5d"],["iface-id","5c3fe5c2-e2df-4f03-bd8f-40af037c4b87"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:07.472411 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f326985-983b-4dae-9e91-44d905d80907]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:07.473040 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:243 - agent port security group processed in 0.468 Sep 27 04:20:07.473847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 2d5f14d8-97ae-45cd-98a4-2634bc19c645 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:07.474152 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 133717b2-0788-457d-9fba-bcfb1664cf21 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:07.474449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for b46b0326-166d-45b8-8db2-cac369fbf847 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:07.592259 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fec34b35-5e95-4ab2-b10a-1134cc497dd1 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:06Z,data_plane_status=None,description='',device_id='484d1f09-a6b1-4259-a367-00e5d24c5c04',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d38ba25f-11e0-4272-a046-108afa9fa96c,mac_address=fa:16:3e:e9:8a:fd,name='',network_id=50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6,numa_affinity_policy=,project_id='312fa89a4d9b43c5919b7bad5411002a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d38ba25f-11e0-4272-a046-108afa9fa96c),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:20:06Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:07.593540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fec34b35-5e95-4ab2-b10a-1134cc497dd1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (d38ba25f-11e0-4272-a046-108afa9fa96c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:07.809343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6faae91c-994b-4d58-9a92-0373d4ded845 None None] Resource Port 3644c780-ef74-4954-a68a-6cc2eadf34ce updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=3644c780-ef74-4954-a68a-6cc2eadf34ce,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=3644c780-ef74-4954-a68a-6cc2eadf34ce,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=3644c780-ef74-4954-a68a-6cc2eadf34ce,segment=NetworkSegment(a913cdfa-72ec-4cc3-8b5c-57a3fb6a0921),segment_id=a913cdfa-72ec-4cc3-8b5c-57a3fb6a0921)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:07.810033 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6faae91c-994b-4d58-9a92-0373d4ded845 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (3644c780-ef74-4954-a68a-6cc2eadf34ce), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:08.054613 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fec34b35-5e95-4ab2-b10a-1134cc497dd1 admin admin] Received resource Port update without any changes: d38ba25f-11e0-4272-a046-108afa9fa96c {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:20:08.184787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-506a471c-4545-44fa-8a65-7591a038ce94 None None] Resource Port 72256acd-5a77-4ad3-be5d-043dcec0575b updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=72256acd-5a77-4ad3-be5d-043dcec0575b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=72256acd-5a77-4ad3-be5d-043dcec0575b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:08.185027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-506a471c-4545-44fa-8a65-7591a038ce94 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (72256acd-5a77-4ad3-be5d-043dcec0575b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:08.312818 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a2b6ce76-bb0e-4e03-812e-17195ec414f3","insert","qg-0013e2cc-d3",["set",[]],["map",[["attached-mac","fa:16:3e:b5:4b:b7"],["iface-id","0013e2cc-d36e-4a05-a5c8-47024496dd16"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:08.330417 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a2b6ce76-bb0e-4e03-812e-17195ec414f3","old",null,["set",[]],null],["","new","qg-0013e2cc-d3",11,["map",[["attached-mac","fa:16:3e:b5:4b:b7"],["iface-id","0013e2cc-d36e-4a05-a5c8-47024496dd16"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:08.519131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-506a471c-4545-44fa-8a65-7591a038ce94 None None] Resource Port 72256acd-5a77-4ad3-be5d-043dcec0575b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=72256acd-5a77-4ad3-be5d-043dcec0575b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=72256acd-5a77-4ad3-be5d-043dcec0575b,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=72256acd-5a77-4ad3-be5d-043dcec0575b,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:08.519522 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-506a471c-4545-44fa-8a65-7591a038ce94 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (72256acd-5a77-4ad3-be5d-043dcec0575b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:08.567244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["03c06cec-f7c7-4f99-8156-92b63793fac2","insert","qr-3644c780-ef",["set",[]],["map",[["attached-mac","fa:16:3e:d1:b9:71"],["iface-id","3644c780-ef74-4954-a68a-6cc2eadf34ce"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:08.588355 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["03c06cec-f7c7-4f99-8156-92b63793fac2","old",null,["set",[]],null],["","new","qr-3644c780-ef",12,["map",[["attached-mac","fa:16:3e:d1:b9:71"],["iface-id","3644c780-ef74-4954-a68a-6cc2eadf34ce"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:08.721372 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:08Z,description='Default security group',id=87f650c3-55f8-48a9-9011-fd16190e4b79,is_default=True,name='default',project_id='7bdb5f97f83b400fb26c5bef99a23ecf',revision_number=1,rules=[SecurityGroupRule(5fb63974-3321-4ae4-937f-615a8ca5dfa9),SecurityGroupRule(cf3b90ae-ae9b-4c33-9328-1cbff6e4acff),SecurityGroupRule(d6755db6-4ae9-4c85-9d49-5bbf9f168ecf),SecurityGroupRule(f682969a-3dd5-4557-8b70-b1b38c154797)],shared=False,stateful=True,updated_at=2022-09-27T04:20:08Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:08.721768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (87f650c3-55f8-48a9-9011-fd16190e4b79), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:08.722636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:08Z,description=,direction='ingress',ethertype='IPv6',id=5fb63974-3321-4ae4-937f-615a8ca5dfa9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bdb5f97f83b400fb26c5bef99a23ecf',protocol=,remote_address_group_id=,remote_group_id=87f650c3-55f8-48a9-9011-fd16190e4b79,remote_ip_prefix=,revision_number=0,security_group_id=87f650c3-55f8-48a9-9011-fd16190e4b79,updated_at=2022-09-27T04:20:08Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:08.723192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5fb63974-3321-4ae4-937f-615a8ca5dfa9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:08.723698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Security group rule updated ['87f650c3-55f8-48a9-9011-fd16190e4b79'] Sep 27 04:20:08.724534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:08Z,description=,direction='egress',ethertype='IPv6',id=cf3b90ae-ae9b-4c33-9328-1cbff6e4acff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bdb5f97f83b400fb26c5bef99a23ecf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=87f650c3-55f8-48a9-9011-fd16190e4b79,updated_at=2022-09-27T04:20:08Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:08.726650 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cf3b90ae-ae9b-4c33-9328-1cbff6e4acff), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:08.727176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Security group rule updated ['87f650c3-55f8-48a9-9011-fd16190e4b79'] Sep 27 04:20:08.729347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:08Z,description=,direction='egress',ethertype='IPv4',id=d6755db6-4ae9-4c85-9d49-5bbf9f168ecf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bdb5f97f83b400fb26c5bef99a23ecf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=87f650c3-55f8-48a9-9011-fd16190e4b79,updated_at=2022-09-27T04:20:08Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:08.729723 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d6755db6-4ae9-4c85-9d49-5bbf9f168ecf), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:08.730090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Security group rule updated ['87f650c3-55f8-48a9-9011-fd16190e4b79'] Sep 27 04:20:08.730759 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:08Z,description=,direction='ingress',ethertype='IPv4',id=f682969a-3dd5-4557-8b70-b1b38c154797,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bdb5f97f83b400fb26c5bef99a23ecf',protocol=,remote_address_group_id=,remote_group_id=87f650c3-55f8-48a9-9011-fd16190e4b79,remote_ip_prefix=,revision_number=0,security_group_id=87f650c3-55f8-48a9-9011-fd16190e4b79,updated_at=2022-09-27T04:20:08Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:08.738378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f682969a-3dd5-4557-8b70-b1b38c154797), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:08.738948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-952eabe8-feb6-4548-9626-883bcca9ead4 admin admin] Security group rule updated ['87f650c3-55f8-48a9-9011-fd16190e4b79'] Sep 27 04:20:09.026517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Resource SecurityGroup deleted: 87f650c3-55f8-48a9-9011-fd16190e4b79 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:09.028078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (87f650c3-55f8-48a9-9011-fd16190e4b79), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:09.028709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('87f650c3-55f8-48a9-9011-fd16190e4b79',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:09.162984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8b564338-1e6a-4071-b719-71a36117ca93 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:07Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ab414d11-ac61-465d-b26b-bf3568c658c0,mac_address=fa:16:3e:ac:16:b5,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ab414d11-ac61-465d-b26b-bf3568c658c0),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:20:08Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:09.163959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8b564338-1e6a-4071-b719-71a36117ca93 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ab414d11-ac61-465d-b26b-bf3568c658c0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:09.503129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('87f650c3-55f8-48a9-9011-fd16190e4b79',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:09.503848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Resource SecurityGroupRule deleted: 5fb63974-3321-4ae4-937f-615a8ca5dfa9 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:09.504525 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5fb63974-3321-4ae4-937f-615a8ca5dfa9), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:09.505066 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Security group rule updated ['87f650c3-55f8-48a9-9011-fd16190e4b79'] Sep 27 04:20:09.505679 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Resource SecurityGroupRule deleted: cf3b90ae-ae9b-4c33-9328-1cbff6e4acff {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:09.506254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cf3b90ae-ae9b-4c33-9328-1cbff6e4acff), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:09.507267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Security group rule updated ['87f650c3-55f8-48a9-9011-fd16190e4b79'] Sep 27 04:20:09.507852 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Resource SecurityGroupRule deleted: d6755db6-4ae9-4c85-9d49-5bbf9f168ecf {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:09.508418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d6755db6-4ae9-4c85-9d49-5bbf9f168ecf), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:09.508961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Security group rule updated ['87f650c3-55f8-48a9-9011-fd16190e4b79'] Sep 27 04:20:09.509533 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Resource SecurityGroupRule deleted: f682969a-3dd5-4557-8b70-b1b38c154797 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:09.510173 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f682969a-3dd5-4557-8b70-b1b38c154797), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:09.510711 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2f39d8ac-ce8d-4916-9af8-72fa1e2d2693 admin admin] Security group rule updated ['87f650c3-55f8-48a9-9011-fd16190e4b79'] Sep 27 04:20:09.624160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-688ca9fe-5a7e-4db6-9876-31293c8951f2 None None] Resource Port 3644c780-ef74-4954-a68a-6cc2eadf34ce updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:09.624477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-688ca9fe-5a7e-4db6-9876-31293c8951f2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (3644c780-ef74-4954-a68a-6cc2eadf34ce), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.083924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port 133717b2-0788-457d-9fba-bcfb1664cf21 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:10.084482 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (133717b2-0788-457d-9fba-bcfb1664cf21), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.100124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:09Z,description='Default security group',id=8fba75e2-2d88-47e9-8e93-721804b489f7,is_default=True,name='default',project_id='7dede4c1da794d3db68881d477955d7d',revision_number=1,rules=[SecurityGroupRule(17d3975a-c410-4920-88d9-3f19ed9abe93),SecurityGroupRule(aea63eb6-c8f7-46e8-8da4-08707184607e),SecurityGroupRule(bc8fa327-48e7-4c6a-84cb-7dd95206bd0c),SecurityGroupRule(bea822e6-318a-44d1-ba4b-2ee836165001)],shared=False,stateful=True,updated_at=2022-09-27T04:20:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:10.102758 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (8fba75e2-2d88-47e9-8e93-721804b489f7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.105774 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:09Z,description=,direction='egress',ethertype='IPv4',id=17d3975a-c410-4920-88d9-3f19ed9abe93,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7dede4c1da794d3db68881d477955d7d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8fba75e2-2d88-47e9-8e93-721804b489f7,updated_at=2022-09-27T04:20:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:10.110500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (17d3975a-c410-4920-88d9-3f19ed9abe93), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.112470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Security group rule updated ['8fba75e2-2d88-47e9-8e93-721804b489f7'] Sep 27 04:20:10.113254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:09Z,description=,direction='ingress',ethertype='IPv4',id=aea63eb6-c8f7-46e8-8da4-08707184607e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7dede4c1da794d3db68881d477955d7d',protocol=,remote_address_group_id=,remote_group_id=8fba75e2-2d88-47e9-8e93-721804b489f7,remote_ip_prefix=,revision_number=0,security_group_id=8fba75e2-2d88-47e9-8e93-721804b489f7,updated_at=2022-09-27T04:20:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:10.114807 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (aea63eb6-c8f7-46e8-8da4-08707184607e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.115474 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Security group rule updated ['8fba75e2-2d88-47e9-8e93-721804b489f7'] Sep 27 04:20:10.118119 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:09Z,description=,direction='ingress',ethertype='IPv6',id=bc8fa327-48e7-4c6a-84cb-7dd95206bd0c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7dede4c1da794d3db68881d477955d7d',protocol=,remote_address_group_id=,remote_group_id=8fba75e2-2d88-47e9-8e93-721804b489f7,remote_ip_prefix=,revision_number=0,security_group_id=8fba75e2-2d88-47e9-8e93-721804b489f7,updated_at=2022-09-27T04:20:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:10.118502 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (bc8fa327-48e7-4c6a-84cb-7dd95206bd0c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.120645 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Security group rule updated ['8fba75e2-2d88-47e9-8e93-721804b489f7'] Sep 27 04:20:10.122388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:09Z,description=,direction='egress',ethertype='IPv6',id=bea822e6-318a-44d1-ba4b-2ee836165001,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7dede4c1da794d3db68881d477955d7d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8fba75e2-2d88-47e9-8e93-721804b489f7,updated_at=2022-09-27T04:20:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:10.122763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (bea822e6-318a-44d1-ba4b-2ee836165001), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.123109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0d7411c2-b574-4721-ac35-1eba8c34bc49 admin admin] Security group rule updated ['8fba75e2-2d88-47e9-8e93-721804b489f7'] Sep 27 04:20:10.191359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8b564338-1e6a-4071-b719-71a36117ca93 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource Port ab414d11-ac61-465d-b26b-bf3568c658c0 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '1ad405be-9703-4a26-a988-bab76e9c13a6'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:10.191359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8b564338-1e6a-4071-b719-71a36117ca93 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ab414d11-ac61-465d-b26b-bf3568c658c0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.256147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['2d5f14d8-97ae-45cd-98a4-2634bc19c645', '133717b2-0788-457d-9fba-bcfb1664cf21', 'b46b0326-166d-45b8-8db2-cac369fbf847'] and devices down [] completed. Sep 27 04:20:10.257334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:243 - ports processed. Elapsed:3.270 Sep 27 04:20:10.257903 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:243 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 3, 'removed': 0}}. Elapsed:3.270 Sep 27 04:20:10.258805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Loop iteration exceeded interval (2 vs. 3.270150661468506)! {{(pid=107232) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 27 04:20:10.259166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:244 started Sep 27 04:20:10.262289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bbd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=86000000,duration_sec=500,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:10.263596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:10.265039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:244 - starting polling. Elapsed:0.005 Sep 27 04:20:10.269996 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.272649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:244 - port information retrieved. Elapsed:0.014 Sep 27 04:20:10.274979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', '133717b2-0788-457d-9fba-bcfb1664cf21', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'3644c780-ef74-4954-a68a-6cc2eadf34ce', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'}, 'removed': set(), 'updated': {'133717b2-0788-457d-9fba-bcfb1664cf21', '3644c780-ef74-4954-a68a-6cc2eadf34ce'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:20:10.277941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '3644c780-ef74-4954-a68a-6cc2eadf34ce', 'device_id': '87ac5442-42b0-4418-857a-78da77f545b5', 'network_id': 'a72f6105-d258-45cb-a84d-18590bef93c2', 'port_id': '3644c780-ef74-4954-a68a-6cc2eadf34ce', 'mac_address': 'fa:16:3e:d1:b9:71', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8e579293-c2b5-4786-882a-437ca24df95d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:10.279144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '133717b2-0788-457d-9fba-bcfb1664cf21', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'network_id': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'port_id': '133717b2-0788-457d-9fba-bcfb1664cf21', 'mac_address': 'fa:16:3e:5c:c8:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7fbc1344-d37e-4e3c-8ea2-baced031ac4e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:10.279874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '0013e2cc-d36e-4a05-a5c8-47024496dd16', 'device_id': '1570ff6f-8fc2-4463-9e5e-3ed7a777c891', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '0013e2cc-d36e-4a05-a5c8-47024496dd16', 'mac_address': 'fa:16:3e:b5:4b:b7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.110'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:10.285438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:02Z,data_plane_status=None,description='',device_id='1570ff6f-8fc2-4463-9e5e-3ed7a777c891',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5c3fe5c2-e2df-4f03-bd8f-40af037c4b87,mac_address=fa:16:3e:ad:cb:5d,name='',network_id=90468030-e15f-4d68-bea3-d020393e070f,numa_affinity_policy=,project_id='7914c4b5217f411f807854ccb07e0365',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(5c3fe5c2-e2df-4f03-bd8f-40af037c4b87),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:20:04Z) is not bound. Sep 27 04:20:10.289032 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 3644c780-ef74-4954-a68a-6cc2eadf34ce {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:10.294680 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 3644c780-ef74-4954-a68a-6cc2eadf34ce updated. Details: {'device': '3644c780-ef74-4954-a68a-6cc2eadf34ce', 'device_id': '87ac5442-42b0-4418-857a-78da77f545b5', 'network_id': 'a72f6105-d258-45cb-a84d-18590bef93c2', 'port_id': '3644c780-ef74-4954-a68a-6cc2eadf34ce', 'mac_address': 'fa:16:3e:d1:b9:71', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8e579293-c2b5-4786-882a-437ca24df95d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Sep 27 04:20:10.303928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3644c780-ef, col_values=(('tag', 4),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.306220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-3644c780-ef, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.306753 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-3644c780-ef, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.334520 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3644c780-ef, col_values=(('other_config', {'net_uuid': 'a72f6105-d258-45cb-a84d-18590bef93c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '113'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.350578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bbf,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:10.351102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 133717b2-0788-457d-9fba-bcfb1664cf21 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:10.351593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 133717b2-0788-457d-9fba-bcfb1664cf21 updated. Details: {'device': '133717b2-0788-457d-9fba-bcfb1664cf21', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'network_id': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'port_id': '133717b2-0788-457d-9fba-bcfb1664cf21', 'mac_address': 'fa:16:3e:5c:c8:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7fbc1344-d37e-4e3c-8ea2-baced031ac4e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Sep 27 04:20:10.352999 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap133717b2-07, col_values=(('tag', 6),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.357165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap133717b2-07, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.357939 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap133717b2-07, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.358645 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:10.359659 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap133717b2-07, col_values=(('other_config', {'net_uuid': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '124', 'tag': '6'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.360535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:10.408129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bc1,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:10.408601 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 0013e2cc-d36e-4a05-a5c8-47024496dd16 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:10.408942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 0013e2cc-d36e-4a05-a5c8-47024496dd16 updated. Details: {'device': '0013e2cc-d36e-4a05-a5c8-47024496dd16', 'device_id': '1570ff6f-8fc2-4463-9e5e-3ed7a777c891', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '0013e2cc-d36e-4a05-a5c8-47024496dd16', 'mac_address': 'fa:16:3e:b5:4b:b7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.110'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:20:10.423545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a05727f2-48b1-437a-9ab0-cd920dfdb7c5 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:10Z,description='tempest-description--449964460',id=34ffa770-a7d9-4d84-9c61-d25f5aba0345,is_default=False,name='tempest-securitygroup--662136365',project_id='312fa89a4d9b43c5919b7bad5411002a',revision_number=1,rules=[SecurityGroupRule(530d00e7-2de0-4f44-97e1-d51c65ed934c),SecurityGroupRule(f1f9e60f-572c-4e65-900b-9e393c72041e)],shared=False,stateful=True,updated_at=2022-09-27T04:20:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:10.423971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a05727f2-48b1-437a-9ab0-cd920dfdb7c5 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (34ffa770-a7d9-4d84-9c61-d25f5aba0345), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.424609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a05727f2-48b1-437a-9ab0-cd920dfdb7c5 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:10Z,description=,direction='egress',ethertype='IPv4',id=530d00e7-2de0-4f44-97e1-d51c65ed934c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=34ffa770-a7d9-4d84-9c61-d25f5aba0345,updated_at=2022-09-27T04:20:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:10.424973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a05727f2-48b1-437a-9ab0-cd920dfdb7c5 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (530d00e7-2de0-4f44-97e1-d51c65ed934c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.428868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a05727f2-48b1-437a-9ab0-cd920dfdb7c5 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['34ffa770-a7d9-4d84-9c61-d25f5aba0345'] Sep 27 04:20:10.429627 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a05727f2-48b1-437a-9ab0-cd920dfdb7c5 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:10Z,description=,direction='egress',ethertype='IPv6',id=f1f9e60f-572c-4e65-900b-9e393c72041e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=34ffa770-a7d9-4d84-9c61-d25f5aba0345,updated_at=2022-09-27T04:20:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:10.430078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a05727f2-48b1-437a-9ab0-cd920dfdb7c5 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f1f9e60f-572c-4e65-900b-9e393c72041e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.430421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a05727f2-48b1-437a-9ab0-cd920dfdb7c5 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['34ffa770-a7d9-4d84-9c61-d25f5aba0345'] Sep 27 04:20:10.432781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0013e2cc-d3, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.433271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0013e2cc-d3, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.433709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0013e2cc-d3, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.444568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Resource SecurityGroup deleted: 8fba75e2-2d88-47e9-8e93-721804b489f7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:10.444954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (8fba75e2-2d88-47e9-8e93-721804b489f7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.445423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8fba75e2-2d88-47e9-8e93-721804b489f7',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:10.474480 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0013e2cc-d3, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:10.502731 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bc3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:10.503904 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:10.512707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 not defined on plugin or binding failed Sep 27 04:20:10.513516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:244 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 11 devices currently available. Time elapsed: 0.236 Sep 27 04:20:10.514182 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 3 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:20:10.515220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'3644c780-ef74-4954-a68a-6cc2eadf34ce', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'} Sep 27 04:20:10.517537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:10.517862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:10.531356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:10.570962 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port b46b0326-166d-45b8-8db2-cac369fbf847 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=b46b0326-166d-45b8-8db2-cac369fbf847,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=b46b0326-166d-45b8-8db2-cac369fbf847,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:10.571597 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b46b0326-166d-45b8-8db2-cac369fbf847), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.572455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8fba75e2-2d88-47e9-8e93-721804b489f7',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:10.573207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Resource SecurityGroupRule deleted: 17d3975a-c410-4920-88d9-3f19ed9abe93 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:10.573716 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (17d3975a-c410-4920-88d9-3f19ed9abe93), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.574238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Security group rule updated ['8fba75e2-2d88-47e9-8e93-721804b489f7'] Sep 27 04:20:10.658949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2155516f-3924-4291-9e95-7cfd2c1936bf]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:10.659716 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:20:10.661837 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:20:10.668233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:10.668606 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:10.672493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Resource SecurityGroupRule deleted: aea63eb6-c8f7-46e8-8da4-08707184607e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:10.676839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (aea63eb6-c8f7-46e8-8da4-08707184607e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.677640 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Security group rule updated ['8fba75e2-2d88-47e9-8e93-721804b489f7'] Sep 27 04:20:10.679535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:10.785693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7d111ee0-fb9f-4949-9ed5-7c8adb6f964e","insert","qr-d38ba25f-11",["set",[]],["map",[["attached-mac","fa:16:3e:e9:8a:fd"],["iface-id","d38ba25f-11e0-4272-a046-108afa9fa96c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:10.807769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7d111ee0-fb9f-4949-9ed5-7c8adb6f964e","old",null,["set",[]],null],["","new","qr-d38ba25f-11",13,["map",[["attached-mac","fa:16:3e:e9:8a:fd"],["iface-id","d38ba25f-11e0-4272-a046-108afa9fa96c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:10.830319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[547af619-e5f6-4b89-a820-04812804fc5b]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:10.830947 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:244 - agent port security group processed in 0.553 Sep 27 04:20:10.832260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 3644c780-ef74-4954-a68a-6cc2eadf34ce to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:10.832721 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 133717b2-0788-457d-9fba-bcfb1664cf21 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:10.833286 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 0013e2cc-d36e-4a05-a5c8-47024496dd16 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:10.837012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Resource SecurityGroupRule deleted: bc8fa327-48e7-4c6a-84cb-7dd95206bd0c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:10.840335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (bc8fa327-48e7-4c6a-84cb-7dd95206bd0c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.840853 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Security group rule updated ['8fba75e2-2d88-47e9-8e93-721804b489f7'] Sep 27 04:20:10.841572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Resource SecurityGroupRule deleted: bea822e6-318a-44d1-ba4b-2ee836165001 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:10.842837 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (bea822e6-318a-44d1-ba4b-2ee836165001), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.843509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f5b11f77-e637-4e69-9869-7502c332561f admin admin] Security group rule updated ['8fba75e2-2d88-47e9-8e93-721804b489f7'] Sep 27 04:20:10.849877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f1c5d8bd-f9e8-47e8-8905-449b8197e5cc tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:10Z,description='',direction='ingress',ethertype='IPv4',id=6d743cc6-d9f1-440d-885c-71164e6ec477,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=34ffa770-a7d9-4d84-9c61-d25f5aba0345,updated_at=2022-09-27T04:20:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:10.855909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f1c5d8bd-f9e8-47e8-8905-449b8197e5cc tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6d743cc6-d9f1-440d-885c-71164e6ec477), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:10.856739 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f1c5d8bd-f9e8-47e8-8905-449b8197e5cc tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['34ffa770-a7d9-4d84-9c61-d25f5aba0345'] Sep 27 04:20:11.627286 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dfba21e4-8105-4e0b-a06c-6dff96308a05 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:11Z,description='',direction='ingress',ethertype='IPv4',id=d0c58644-d510-42d0-8615-9f47df5d4142,normalized_cidr=None,port_range_max=,port_range_min=,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=34ffa770-a7d9-4d84-9c61-d25f5aba0345,updated_at=2022-09-27T04:20:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:11.628015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dfba21e4-8105-4e0b-a06c-6dff96308a05 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d0c58644-d510-42d0-8615-9f47df5d4142), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:11.628015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-dfba21e4-8105-4e0b-a06c-6dff96308a05 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['34ffa770-a7d9-4d84-9c61-d25f5aba0345'] Sep 27 04:20:11.665621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["95b3bff4-9f0c-42e0-9fc1-8ebc587b2af6","insert","qg-72256acd-5a",["set",[]],["map",[["attached-mac","fa:16:3e:2e:dc:79"],["iface-id","72256acd-5a77-4ad3-be5d-043dcec0575b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:11.684629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["95b3bff4-9f0c-42e0-9fc1-8ebc587b2af6","old",null,["set",[]],null],["","new","qg-72256acd-5a",14,["map",[["attached-mac","fa:16:3e:2e:dc:79"],["iface-id","72256acd-5a77-4ad3-be5d-043dcec0575b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:20:11.837499 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['3644c780-ef74-4954-a68a-6cc2eadf34ce', '133717b2-0788-457d-9fba-bcfb1664cf21', '0013e2cc-d36e-4a05-a5c8-47024496dd16'] and devices down [] completed. Sep 27 04:20:11.838199 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:244 - ports processed. Elapsed:1.579 Sep 27 04:20:11.839753 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:244 completed. Processed ports statistics: {'regular': {'added': 3, 'updated': 2, 'removed': 0}}. Elapsed:1.580 Sep 27 04:20:11.973627 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port 0013e2cc-d36e-4a05-a5c8-47024496dd16 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=0013e2cc-d36e-4a05-a5c8-47024496dd16,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=0013e2cc-d36e-4a05-a5c8-47024496dd16,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:11.974845 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0013e2cc-d36e-4a05-a5c8-47024496dd16), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:12.274235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:245 started Sep 27 04:20:12.280693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bc5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=101000000,duration_sec=502,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:12.281391 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:12.282270 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:245 - starting polling. Elapsed:0.008 Sep 27 04:20:12.285781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:12.289988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:245 - port information retrieved. Elapsed:0.016 Sep 27 04:20:12.290477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', '133717b2-0788-457d-9fba-bcfb1664cf21', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'d38ba25f-11e0-4272-a046-108afa9fa96c', '72256acd-5a77-4ad3-be5d-043dcec0575b'}, 'removed': set(), 'updated': {'b46b0326-166d-45b8-8db2-cac369fbf847', '0013e2cc-d36e-4a05-a5c8-47024496dd16'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:20:12.291271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'b46b0326-166d-45b8-8db2-cac369fbf847', 'device_id': '87ac5442-42b0-4418-857a-78da77f545b5', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'b46b0326-166d-45b8-8db2-cac369fbf847', 'mac_address': 'fa:16:3e:e9:78:58', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.71'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:12.292552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:06Z,data_plane_status=None,description='',device_id='484d1f09-a6b1-4259-a367-00e5d24c5c04',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d38ba25f-11e0-4272-a046-108afa9fa96c,mac_address=fa:16:3e:e9:8a:fd,name='',network_id=50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6,numa_affinity_policy=,project_id='312fa89a4d9b43c5919b7bad5411002a',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(d38ba25f-11e0-4272-a046-108afa9fa96c),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:20:07Z) is not bound. Sep 27 04:20:12.293708 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '72256acd-5a77-4ad3-be5d-043dcec0575b', 'device_id': '484d1f09-a6b1-4259-a367-00e5d24c5c04', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '72256acd-5a77-4ad3-be5d-043dcec0575b', 'mac_address': 'fa:16:3e:2e:dc:79', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.125'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:12.294981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '0013e2cc-d36e-4a05-a5c8-47024496dd16', 'device_id': '1570ff6f-8fc2-4463-9e5e-3ed7a777c891', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '0013e2cc-d36e-4a05-a5c8-47024496dd16', 'mac_address': 'fa:16:3e:b5:4b:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.110'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:12.299354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: b46b0326-166d-45b8-8db2-cac369fbf847 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:12.299893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b46b0326-166d-45b8-8db2-cac369fbf847 updated. Details: {'device': 'b46b0326-166d-45b8-8db2-cac369fbf847', 'device_id': '87ac5442-42b0-4418-857a-78da77f545b5', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'b46b0326-166d-45b8-8db2-cac369fbf847', 'mac_address': 'fa:16:3e:e9:78:58', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.71'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:20:12.301087 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b46b0326-16, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.301673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-b46b0326-16, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.302242 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-b46b0326-16, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.302822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:12.304340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b46b0326-16, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.305204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:12.308805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bc7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:12.309374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: d38ba25f-11e0-4272-a046-108afa9fa96c {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:12.310122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device d38ba25f-11e0-4272-a046-108afa9fa96c not defined on plugin or binding failed Sep 27 04:20:12.310856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 72256acd-5a77-4ad3-be5d-043dcec0575b {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:12.311360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 72256acd-5a77-4ad3-be5d-043dcec0575b updated. Details: {'device': '72256acd-5a77-4ad3-be5d-043dcec0575b', 'device_id': '484d1f09-a6b1-4259-a367-00e5d24c5c04', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '72256acd-5a77-4ad3-be5d-043dcec0575b', 'mac_address': 'fa:16:3e:2e:dc:79', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.125'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:20:12.313779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-72256acd-5a, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.317561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-72256acd-5a, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.320233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-72256acd-5a, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.341883 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-72256acd-5a, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.359548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bc9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:12.371294 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 0013e2cc-d36e-4a05-a5c8-47024496dd16 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:12.372043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 0013e2cc-d36e-4a05-a5c8-47024496dd16 updated. Details: {'device': '0013e2cc-d36e-4a05-a5c8-47024496dd16', 'device_id': '1570ff6f-8fc2-4463-9e5e-3ed7a777c891', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '0013e2cc-d36e-4a05-a5c8-47024496dd16', 'mac_address': 'fa:16:3e:b5:4b:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.110'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:20:12.373503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0013e2cc-d3, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.374950 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0013e2cc-d3, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.375551 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0013e2cc-d3, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.376263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:12.377848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0013e2cc-d3, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:12.378862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:12.381813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bcb,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:12.382298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:245 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.091 Sep 27 04:20:12.382723 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 2 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:20:12.383090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'d38ba25f-11e0-4272-a046-108afa9fa96c', '72256acd-5a77-4ad3-be5d-043dcec0575b'} Sep 27 04:20:12.384831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:12.385190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:12.390042 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:12.482517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c6874a-d6f3-418b-b423-2d7781bb762f]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:12.484038 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 2 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:20:12.484528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:20:12.486620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:12.487146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:12.492655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:12.584414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[57efcf22-6c51-41eb-844d-ed1b620a605c]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:12.585877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:245 - agent port security group processed in 0.295 Sep 27 04:20:12.586982 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for b46b0326-166d-45b8-8db2-cac369fbf847 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:12.587534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 72256acd-5a77-4ad3-be5d-043dcec0575b to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:12.588096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 0013e2cc-d36e-4a05-a5c8-47024496dd16 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:13.584234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-06c9b811-5ae8-4210-b2bb-e7628c6a8d8d tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:12Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f3a8b4a6-2987-4295-939e-4a2a5803075b,mac_address=fa:16:3e:f2:0c:c5,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f3a8b4a6-2987-4295-939e-4a2a5803075b),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:20:12Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:13.589510 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-06c9b811-5ae8-4210-b2bb-e7628c6a8d8d tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f3a8b4a6-2987-4295-939e-4a2a5803075b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:13.900655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6a815a07-0221-4df7-a5b9-1129361ce908 None None] Resource Port 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=5c3fe5c2-e2df-4f03-bd8f-40af037c4b87,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=5c3fe5c2-e2df-4f03-bd8f-40af037c4b87,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:13.901084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6a815a07-0221-4df7-a5b9-1129361ce908 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (5c3fe5c2-e2df-4f03-bd8f-40af037c4b87), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:13.981784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port 72256acd-5a77-4ad3-be5d-043dcec0575b updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=72256acd-5a77-4ad3-be5d-043dcec0575b,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=72256acd-5a77-4ad3-be5d-043dcec0575b,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:13.982359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (72256acd-5a77-4ad3-be5d-043dcec0575b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:14.137876 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['b46b0326-166d-45b8-8db2-cac369fbf847', '72256acd-5a77-4ad3-be5d-043dcec0575b', '0013e2cc-d36e-4a05-a5c8-47024496dd16'] and devices down [] completed. Sep 27 04:20:14.138568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:245 - ports processed. Elapsed:1.865 Sep 27 04:20:14.139071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:245 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:1.865 Sep 27 04:20:14.275080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:246 started Sep 27 04:20:14.278240 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bcd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=102000000,duration_sec=504,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:14.278905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:14.279357 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:246 - starting polling. Elapsed:0.004 Sep 27 04:20:14.282596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:14.288273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:246 - port information retrieved. Elapsed:0.013 Sep 27 04:20:14.291468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', '133717b2-0788-457d-9fba-bcfb1664cf21', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': set(), 'updated': {'72256acd-5a77-4ad3-be5d-043dcec0575b', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:20:14.308491 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '72256acd-5a77-4ad3-be5d-043dcec0575b', 'device_id': '484d1f09-a6b1-4259-a367-00e5d24c5c04', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '72256acd-5a77-4ad3-be5d-043dcec0575b', 'mac_address': 'fa:16:3e:2e:dc:79', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.125'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:14.312436 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:02Z,data_plane_status=None,description='',device_id='1570ff6f-8fc2-4463-9e5e-3ed7a777c891',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5c3fe5c2-e2df-4f03-bd8f-40af037c4b87,mac_address=fa:16:3e:ad:cb:5d,name='',network_id=90468030-e15f-4d68-bea3-d020393e070f,numa_affinity_policy=,project_id='7914c4b5217f411f807854ccb07e0365',qos_network_policy_id=None,qos_policy_id=None,revision_number=3,security=PortSecurity(5c3fe5c2-e2df-4f03-bd8f-40af037c4b87),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:20:13Z) is not bound. Sep 27 04:20:14.337724 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 72256acd-5a77-4ad3-be5d-043dcec0575b {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:14.338095 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 72256acd-5a77-4ad3-be5d-043dcec0575b updated. Details: {'device': '72256acd-5a77-4ad3-be5d-043dcec0575b', 'device_id': '484d1f09-a6b1-4259-a367-00e5d24c5c04', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '72256acd-5a77-4ad3-be5d-043dcec0575b', 'mac_address': 'fa:16:3e:2e:dc:79', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.125'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:20:14.343033 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-72256acd-5a, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:14.346440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-72256acd-5a, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:14.347584 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-72256acd-5a, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:14.348810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:14.360318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-06c9b811-5ae8-4210-b2bb-e7628c6a8d8d tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource Port f3a8b4a6-2987-4295-939e-4a2a5803075b updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '66179e57-7da1-4953-9db1-3d263a97c895'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:14.362407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-06c9b811-5ae8-4210-b2bb-e7628c6a8d8d tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f3a8b4a6-2987-4295-939e-4a2a5803075b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:14.366519 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-72256acd-5a, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:14.368756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:14.384796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bcf,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:14.392283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:14.392616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 not defined on plugin or binding failed Sep 27 04:20:14.393190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:246 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.100 Sep 27 04:20:14.395359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 2 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:20:14.395667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:20:14.399953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:14.401427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:14.416341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:14.516339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c01a56f-c7b7-4b4d-b1a0-fdbfc760a4f8]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:14.517200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:246 - agent port security group processed in 0.224 Sep 27 04:20:14.518126 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 72256acd-5a77-4ad3-be5d-043dcec0575b to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:15.613054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['72256acd-5a77-4ad3-be5d-043dcec0575b'] and devices down [] completed. Sep 27 04:20:15.613790 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:246 - ports processed. Elapsed:1.338 Sep 27 04:20:15.613790 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:246 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:1.339 Sep 27 04:20:15.784310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:15Z,description='Default security group',id=fcee1793-539b-4b74-b59d-37139346ac9e,is_default=True,name='default',project_id='03e64281787145cc82cb14497b022a36',revision_number=1,rules=[SecurityGroupRule(0e3a157d-3f10-44cd-94de-e8a1cff250fb),SecurityGroupRule(404b6706-f81c-4f44-ad69-d37c5430b1e8),SecurityGroupRule(421d028f-581c-41df-a213-b92166d1237c),SecurityGroupRule(edfadff4-f5a0-438a-8360-b2da8497af03)],shared=False,stateful=True,updated_at=2022-09-27T04:20:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:15.785192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (fcee1793-539b-4b74-b59d-37139346ac9e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:15.797813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:15Z,description=,direction='ingress',ethertype='IPv6',id=0e3a157d-3f10-44cd-94de-e8a1cff250fb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03e64281787145cc82cb14497b022a36',protocol=,remote_address_group_id=,remote_group_id=fcee1793-539b-4b74-b59d-37139346ac9e,remote_ip_prefix=,revision_number=0,security_group_id=fcee1793-539b-4b74-b59d-37139346ac9e,updated_at=2022-09-27T04:20:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:15.800555 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0e3a157d-3f10-44cd-94de-e8a1cff250fb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:15.801045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Security group rule updated ['fcee1793-539b-4b74-b59d-37139346ac9e'] Sep 27 04:20:15.802606 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:15Z,description=,direction='ingress',ethertype='IPv4',id=404b6706-f81c-4f44-ad69-d37c5430b1e8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03e64281787145cc82cb14497b022a36',protocol=,remote_address_group_id=,remote_group_id=fcee1793-539b-4b74-b59d-37139346ac9e,remote_ip_prefix=,revision_number=0,security_group_id=fcee1793-539b-4b74-b59d-37139346ac9e,updated_at=2022-09-27T04:20:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:15.804001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (404b6706-f81c-4f44-ad69-d37c5430b1e8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:15.805722 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Security group rule updated ['fcee1793-539b-4b74-b59d-37139346ac9e'] Sep 27 04:20:15.820887 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:15Z,description=,direction='egress',ethertype='IPv4',id=421d028f-581c-41df-a213-b92166d1237c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03e64281787145cc82cb14497b022a36',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fcee1793-539b-4b74-b59d-37139346ac9e,updated_at=2022-09-27T04:20:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:15.822945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (421d028f-581c-41df-a213-b92166d1237c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:15.825809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Security group rule updated ['fcee1793-539b-4b74-b59d-37139346ac9e'] Sep 27 04:20:15.832290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:15Z,description=,direction='egress',ethertype='IPv6',id=edfadff4-f5a0-438a-8360-b2da8497af03,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03e64281787145cc82cb14497b022a36',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fcee1793-539b-4b74-b59d-37139346ac9e,updated_at=2022-09-27T04:20:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:15.842796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (edfadff4-f5a0-438a-8360-b2da8497af03), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:15.843315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f8e9b31c-458d-4a71-989e-f09bb1fc05a4 admin admin] Security group rule updated ['fcee1793-539b-4b74-b59d-37139346ac9e'] Sep 27 04:20:15.925936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6a815a07-0221-4df7-a5b9-1129361ce908 None None] Resource Port 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=5c3fe5c2-e2df-4f03-bd8f-40af037c4b87,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=5c3fe5c2-e2df-4f03-bd8f-40af037c4b87,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=5c3fe5c2-e2df-4f03-bd8f-40af037c4b87,segment=NetworkSegment(140b4dbd-c7b9-40d2-9281-c4e4b44aa6c5),segment_id=140b4dbd-c7b9-40d2-9281-c4e4b44aa6c5)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:15.926322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6a815a07-0221-4df7-a5b9-1129361ce908 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (5c3fe5c2-e2df-4f03-bd8f-40af037c4b87), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:16.275682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:247 started Sep 27 04:20:16.279337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bd1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=103000000,duration_sec=506,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:16.280154 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:16.281297 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:247 - starting polling. Elapsed:0.006 Sep 27 04:20:16.284487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:16.288384 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:247 - port information retrieved. Elapsed:0.012 Sep 27 04:20:16.288912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', '133717b2-0788-457d-9fba-bcfb1664cf21', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': set(), 'updated': {'5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:20:16.290762 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', 'device_id': '1570ff6f-8fc2-4463-9e5e-3ed7a777c891', 'network_id': '90468030-e15f-4d68-bea3-d020393e070f', 'port_id': '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', 'mac_address': 'fa:16:3e:ad:cb:5d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ef556055-3d79-4e00-91ba-4215c47f3d3a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:16.303543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:16.305392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 updated. Details: {'device': '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', 'device_id': '1570ff6f-8fc2-4463-9e5e-3ed7a777c891', 'network_id': '90468030-e15f-4d68-bea3-d020393e070f', 'port_id': '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', 'mac_address': 'fa:16:3e:ad:cb:5d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ef556055-3d79-4e00-91ba-4215c47f3d3a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Sep 27 04:20:16.332510 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-5c3fe5c2-e2, col_values=(('tag', 5),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:16.333002 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-5c3fe5c2-e2, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:16.333446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-5c3fe5c2-e2, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:16.352153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-5c3fe5c2-e2, col_values=(('other_config', {'net_uuid': '90468030-e15f-4d68-bea3-d020393e070f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '141'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:16.367397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bd3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:16.368068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:247 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.078 Sep 27 04:20:16.368568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:20:16.369716 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:20:16.371733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:16.372359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:16.378918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:16.485336 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1ac7b7-9ae5-4cad-9266-1982b4e73c11]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:16.486088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:247 - agent port security group processed in 0.196 Sep 27 04:20:16.486874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:16.753865 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Resource SecurityGroup deleted: fcee1793-539b-4b74-b59d-37139346ac9e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:16.755957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (fcee1793-539b-4b74-b59d-37139346ac9e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:16.756677 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fcee1793-539b-4b74-b59d-37139346ac9e',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:16.962862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fcee1793-539b-4b74-b59d-37139346ac9e',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:16.963546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Resource SecurityGroupRule deleted: 0e3a157d-3f10-44cd-94de-e8a1cff250fb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:16.964068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0e3a157d-3f10-44cd-94de-e8a1cff250fb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:16.964569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Security group rule updated ['fcee1793-539b-4b74-b59d-37139346ac9e'] Sep 27 04:20:16.965238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Resource SecurityGroupRule deleted: 404b6706-f81c-4f44-ad69-d37c5430b1e8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:16.965732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (404b6706-f81c-4f44-ad69-d37c5430b1e8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:16.966325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Security group rule updated ['fcee1793-539b-4b74-b59d-37139346ac9e'] Sep 27 04:20:16.966841 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Resource SecurityGroupRule deleted: 421d028f-581c-41df-a213-b92166d1237c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:16.967334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (421d028f-581c-41df-a213-b92166d1237c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:16.967836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Security group rule updated ['fcee1793-539b-4b74-b59d-37139346ac9e'] Sep 27 04:20:16.968362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Resource SecurityGroupRule deleted: edfadff4-f5a0-438a-8360-b2da8497af03 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:16.969231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (edfadff4-f5a0-438a-8360-b2da8497af03), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:16.969856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c3cffaa9-36cd-4522-9e69-e3838d3130dc admin admin] Security group rule updated ['fcee1793-539b-4b74-b59d-37139346ac9e'] Sep 27 04:20:18.351159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:16Z,description='Default security group',id=8891bddb-189f-47ad-a30c-6739966db708,is_default=True,name='default',project_id='8d1245be9be24a5fbae54af071270e21',revision_number=1,rules=[SecurityGroupRule(11e4938d-0508-48d2-918f-65b2aedff993),SecurityGroupRule(295b7952-e07b-45bc-b72a-e088164972f3),SecurityGroupRule(b9ae4d3e-4c8f-4fdf-b163-659f10ec943f),SecurityGroupRule(f54a9edc-728e-442c-96d4-effd9ebe68f7)],shared=False,stateful=True,updated_at=2022-09-27T04:20:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:18.351759 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (8891bddb-189f-47ad-a30c-6739966db708), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:18.355138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:17Z,description=,direction='ingress',ethertype='IPv6',id=11e4938d-0508-48d2-918f-65b2aedff993,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d1245be9be24a5fbae54af071270e21',protocol=,remote_address_group_id=,remote_group_id=8891bddb-189f-47ad-a30c-6739966db708,remote_ip_prefix=,revision_number=0,security_group_id=8891bddb-189f-47ad-a30c-6739966db708,updated_at=2022-09-27T04:20:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:18.355589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (11e4938d-0508-48d2-918f-65b2aedff993), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:18.357078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Security group rule updated ['8891bddb-189f-47ad-a30c-6739966db708'] Sep 27 04:20:18.358573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:17Z,description=,direction='egress',ethertype='IPv4',id=295b7952-e07b-45bc-b72a-e088164972f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d1245be9be24a5fbae54af071270e21',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8891bddb-189f-47ad-a30c-6739966db708,updated_at=2022-09-27T04:20:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:18.360700 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (295b7952-e07b-45bc-b72a-e088164972f3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:18.362245 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Security group rule updated ['8891bddb-189f-47ad-a30c-6739966db708'] Sep 27 04:20:18.363864 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:17Z,description=,direction='egress',ethertype='IPv6',id=b9ae4d3e-4c8f-4fdf-b163-659f10ec943f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d1245be9be24a5fbae54af071270e21',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8891bddb-189f-47ad-a30c-6739966db708,updated_at=2022-09-27T04:20:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:18.364409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b9ae4d3e-4c8f-4fdf-b163-659f10ec943f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:18.370964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Security group rule updated ['8891bddb-189f-47ad-a30c-6739966db708'] Sep 27 04:20:18.373302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:17Z,description=,direction='ingress',ethertype='IPv4',id=f54a9edc-728e-442c-96d4-effd9ebe68f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d1245be9be24a5fbae54af071270e21',protocol=,remote_address_group_id=,remote_group_id=8891bddb-189f-47ad-a30c-6739966db708,remote_ip_prefix=,revision_number=0,security_group_id=8891bddb-189f-47ad-a30c-6739966db708,updated_at=2022-09-27T04:20:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:18.374367 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f54a9edc-728e-442c-96d4-effd9ebe68f7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:18.375157 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fab61a58-d5d4-4111-9eca-cfb5058c833e admin admin] Security group rule updated ['8891bddb-189f-47ad-a30c-6739966db708'] Sep 27 04:20:18.520170 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:17Z,description='Default security group',id=053b8d58-809c-42fd-b227-a2106fd31162,is_default=True,name='default',project_id='7bafa7cf29ca4c1cb3b8f660ef47b739',revision_number=1,rules=[SecurityGroupRule(11cefa80-7aa5-4a7d-b2ff-9aa6ed421e22),SecurityGroupRule(188766c2-2b4d-43ad-8684-80da59a7e45a),SecurityGroupRule(8d610b48-a7fd-4c50-9b5d-537bf0640f6e),SecurityGroupRule(e33d2273-983a-4e06-aabc-0b41aafa91ec)],shared=False,stateful=True,updated_at=2022-09-27T04:20:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:18.520617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (053b8d58-809c-42fd-b227-a2106fd31162), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:18.521227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:17Z,description=,direction='egress',ethertype='IPv6',id=11cefa80-7aa5-4a7d-b2ff-9aa6ed421e22,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bafa7cf29ca4c1cb3b8f660ef47b739',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=053b8d58-809c-42fd-b227-a2106fd31162,updated_at=2022-09-27T04:20:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:18.521646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (11cefa80-7aa5-4a7d-b2ff-9aa6ed421e22), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:18.523029 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Security group rule updated ['053b8d58-809c-42fd-b227-a2106fd31162'] Sep 27 04:20:18.524025 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:17Z,description=,direction='ingress',ethertype='IPv6',id=188766c2-2b4d-43ad-8684-80da59a7e45a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bafa7cf29ca4c1cb3b8f660ef47b739',protocol=,remote_address_group_id=,remote_group_id=053b8d58-809c-42fd-b227-a2106fd31162,remote_ip_prefix=,revision_number=0,security_group_id=053b8d58-809c-42fd-b227-a2106fd31162,updated_at=2022-09-27T04:20:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:18.525626 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (188766c2-2b4d-43ad-8684-80da59a7e45a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:18.528960 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Security group rule updated ['053b8d58-809c-42fd-b227-a2106fd31162'] Sep 27 04:20:18.529929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:17Z,description=,direction='ingress',ethertype='IPv4',id=8d610b48-a7fd-4c50-9b5d-537bf0640f6e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bafa7cf29ca4c1cb3b8f660ef47b739',protocol=,remote_address_group_id=,remote_group_id=053b8d58-809c-42fd-b227-a2106fd31162,remote_ip_prefix=,revision_number=0,security_group_id=053b8d58-809c-42fd-b227-a2106fd31162,updated_at=2022-09-27T04:20:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:18.535098 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8d610b48-a7fd-4c50-9b5d-537bf0640f6e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:18.536427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Security group rule updated ['053b8d58-809c-42fd-b227-a2106fd31162'] Sep 27 04:20:18.540179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:17Z,description=,direction='egress',ethertype='IPv4',id=e33d2273-983a-4e06-aabc-0b41aafa91ec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bafa7cf29ca4c1cb3b8f660ef47b739',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=053b8d58-809c-42fd-b227-a2106fd31162,updated_at=2022-09-27T04:20:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:18.540719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e33d2273-983a-4e06-aabc-0b41aafa91ec), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:18.541359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-61f149fc-70ca-42e2-a4fe-db992f332ed0 admin admin] Security group rule updated ['053b8d58-809c-42fd-b227-a2106fd31162'] Sep 27 04:20:19.039223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-299eca02-3086-4204-b2e0-5a4f384b4e52 None None] Resource Port d38ba25f-11e0-4272-a046-108afa9fa96c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=d38ba25f-11e0-4272-a046-108afa9fa96c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=d38ba25f-11e0-4272-a046-108afa9fa96c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:19.040964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-299eca02-3086-4204-b2e0-5a4f384b4e52 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (d38ba25f-11e0-4272-a046-108afa9fa96c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.191955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'] and devices down [] completed. Sep 27 04:20:19.192292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:247 - ports processed. Elapsed:2.917 Sep 27 04:20:19.192732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:247 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:2.917 Sep 27 04:20:19.194323 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Loop iteration exceeded interval (2 vs. 2.917123556137085)! {{(pid=107232) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 27 04:20:19.194712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:248 started Sep 27 04:20:19.198130 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bd5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=21000000,duration_sec=509,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:19.198742 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:19.199240 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:248 - starting polling. Elapsed:0.004 Sep 27 04:20:19.215918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.232512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:248 - port information retrieved. Elapsed:0.037 Sep 27 04:20:19.232865 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', '133717b2-0788-457d-9fba-bcfb1664cf21', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': set(), 'updated': {'d38ba25f-11e0-4272-a046-108afa9fa96c'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:20:19.238621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:06Z,data_plane_status=None,description='',device_id='484d1f09-a6b1-4259-a367-00e5d24c5c04',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d38ba25f-11e0-4272-a046-108afa9fa96c,mac_address=fa:16:3e:e9:8a:fd,name='',network_id=50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6,numa_affinity_policy=,project_id='312fa89a4d9b43c5919b7bad5411002a',qos_network_policy_id=None,qos_policy_id=None,revision_number=3,security=PortSecurity(d38ba25f-11e0-4272-a046-108afa9fa96c),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:20:18Z) is not bound. Sep 27 04:20:19.250902 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: d38ba25f-11e0-4272-a046-108afa9fa96c {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:19.252070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device d38ba25f-11e0-4272-a046-108afa9fa96c not defined on plugin or binding failed Sep 27 04:20:19.252974 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:248 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.020 Sep 27 04:20:19.254080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:20:19.256017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:20:19.257631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:19.258520 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:19.269016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:248 - agent port security group processed in 0.034 Sep 27 04:20:19.274444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:20:19.274795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:248 - ports processed. Elapsed:0.080 Sep 27 04:20:19.275194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:248 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.081 Sep 27 04:20:19.411935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Resource SecurityGroup deleted: 8891bddb-189f-47ad-a30c-6739966db708 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:19.412493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (8891bddb-189f-47ad-a30c-6739966db708), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.412763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8891bddb-189f-47ad-a30c-6739966db708',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:19.529053 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:18Z,description='Default security group',id=f0452a84-e8c9-496b-af21-e94403e95e18,is_default=True,name='default',project_id='0699af01ace347ecb12751b6b819e4de',revision_number=1,rules=[SecurityGroupRule(7b496824-dd18-4d15-b046-fe9f928adf28),SecurityGroupRule(92b3e76d-9327-49cc-bd4e-d573c1ca2f01),SecurityGroupRule(b2623013-9a33-401f-8ed1-34a1c0b8810a),SecurityGroupRule(c18d85a4-af2d-451d-a083-36eafbda4989)],shared=False,stateful=True,updated_at=2022-09-27T04:20:18Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:19.529880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (f0452a84-e8c9-496b-af21-e94403e95e18), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.530926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:18Z,description=,direction='ingress',ethertype='IPv4',id=7b496824-dd18-4d15-b046-fe9f928adf28,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0699af01ace347ecb12751b6b819e4de',protocol=,remote_address_group_id=,remote_group_id=f0452a84-e8c9-496b-af21-e94403e95e18,remote_ip_prefix=,revision_number=0,security_group_id=f0452a84-e8c9-496b-af21-e94403e95e18,updated_at=2022-09-27T04:20:18Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:19.531452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7b496824-dd18-4d15-b046-fe9f928adf28), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.532201 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Security group rule updated ['f0452a84-e8c9-496b-af21-e94403e95e18'] Sep 27 04:20:19.534044 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:18Z,description=,direction='egress',ethertype='IPv4',id=92b3e76d-9327-49cc-bd4e-d573c1ca2f01,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0699af01ace347ecb12751b6b819e4de',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f0452a84-e8c9-496b-af21-e94403e95e18,updated_at=2022-09-27T04:20:18Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:19.535082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (92b3e76d-9327-49cc-bd4e-d573c1ca2f01), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.536516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Security group rule updated ['f0452a84-e8c9-496b-af21-e94403e95e18'] Sep 27 04:20:19.537644 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:18Z,description=,direction='ingress',ethertype='IPv6',id=b2623013-9a33-401f-8ed1-34a1c0b8810a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0699af01ace347ecb12751b6b819e4de',protocol=,remote_address_group_id=,remote_group_id=f0452a84-e8c9-496b-af21-e94403e95e18,remote_ip_prefix=,revision_number=0,security_group_id=f0452a84-e8c9-496b-af21-e94403e95e18,updated_at=2022-09-27T04:20:18Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:19.539826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b2623013-9a33-401f-8ed1-34a1c0b8810a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.542442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Security group rule updated ['f0452a84-e8c9-496b-af21-e94403e95e18'] Sep 27 04:20:19.543328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:18Z,description=,direction='egress',ethertype='IPv6',id=c18d85a4-af2d-451d-a083-36eafbda4989,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0699af01ace347ecb12751b6b819e4de',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f0452a84-e8c9-496b-af21-e94403e95e18,updated_at=2022-09-27T04:20:18Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:19.545232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c18d85a4-af2d-451d-a083-36eafbda4989), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.547900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-aa0a3d99-5bd4-4299-b209-ff1b9c0287c6 admin admin] Security group rule updated ['f0452a84-e8c9-496b-af21-e94403e95e18'] Sep 27 04:20:19.576182 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:19.576717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (5c3fe5c2-e2df-4f03-bd8f-40af037c4b87), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.582417 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8891bddb-189f-47ad-a30c-6739966db708',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:19.582935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Resource SecurityGroupRule deleted: 11e4938d-0508-48d2-918f-65b2aedff993 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:19.587699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (11e4938d-0508-48d2-918f-65b2aedff993), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.588428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Security group rule updated ['8891bddb-189f-47ad-a30c-6739966db708'] Sep 27 04:20:19.590382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Resource SecurityGroupRule deleted: 295b7952-e07b-45bc-b72a-e088164972f3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:19.591592 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (295b7952-e07b-45bc-b72a-e088164972f3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.592636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Security group rule updated ['8891bddb-189f-47ad-a30c-6739966db708'] Sep 27 04:20:19.594275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Resource SecurityGroupRule deleted: b9ae4d3e-4c8f-4fdf-b163-659f10ec943f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:19.596168 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b9ae4d3e-4c8f-4fdf-b163-659f10ec943f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.598441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Security group rule updated ['8891bddb-189f-47ad-a30c-6739966db708'] Sep 27 04:20:19.599929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Resource SecurityGroupRule deleted: f54a9edc-728e-442c-96d4-effd9ebe68f7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:19.600784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f54a9edc-728e-442c-96d4-effd9ebe68f7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.602690 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6650ec77-4d0e-4480-9dc9-f7dda0a9ea63 admin admin] Security group rule updated ['8891bddb-189f-47ad-a30c-6739966db708'] Sep 27 04:20:19.669100 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d1b42dc5-7234-4500-91cf-ea7e51554b6c tempest-DeleteServersTestJSON-1833106251 tempest-DeleteServersTestJSON-1833106251-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:15Z,data_plane_status=None,description='',device_id='355252e2-3471-4c92-95d1-adcecc4033c7',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=acd21fd8-866c-4c10-9697-2fe37ef43cf1,mac_address=fa:16:3e:55:f7:c6,name='',network_id=90468030-e15f-4d68-bea3-d020393e070f,numa_affinity_policy=,project_id='7914c4b5217f411f807854ccb07e0365',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(acd21fd8-866c-4c10-9697-2fe37ef43cf1),security_group_ids=set([6292e5d4-a4a9-48a7-955f-6a9e34544572]),status='DOWN',updated_at=2022-09-27T04:20:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:19.670663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d1b42dc5-7234-4500-91cf-ea7e51554b6c tempest-DeleteServersTestJSON-1833106251 tempest-DeleteServersTestJSON-1833106251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (acd21fd8-866c-4c10-9697-2fe37ef43cf1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.672096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d1b42dc5-7234-4500-91cf-ea7e51554b6c tempest-DeleteServersTestJSON-1833106251 tempest-DeleteServersTestJSON-1833106251-project] Security group member updated {'6292e5d4-a4a9-48a7-955f-6a9e34544572'} Sep 27 04:20:19.698223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Resource SecurityGroup deleted: 053b8d58-809c-42fd-b227-a2106fd31162 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:19.698677 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (053b8d58-809c-42fd-b227-a2106fd31162), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.699146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('053b8d58-809c-42fd-b227-a2106fd31162',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:19.810765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('053b8d58-809c-42fd-b227-a2106fd31162',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:19.812176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Resource SecurityGroupRule deleted: 11cefa80-7aa5-4a7d-b2ff-9aa6ed421e22 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:19.813042 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (11cefa80-7aa5-4a7d-b2ff-9aa6ed421e22), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.813523 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Security group rule updated ['053b8d58-809c-42fd-b227-a2106fd31162'] Sep 27 04:20:19.814221 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Resource SecurityGroupRule deleted: 188766c2-2b4d-43ad-8684-80da59a7e45a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:19.814863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (188766c2-2b4d-43ad-8684-80da59a7e45a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.815406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Security group rule updated ['053b8d58-809c-42fd-b227-a2106fd31162'] Sep 27 04:20:19.815978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Resource SecurityGroupRule deleted: 8d610b48-a7fd-4c50-9b5d-537bf0640f6e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:19.816567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (8d610b48-a7fd-4c50-9b5d-537bf0640f6e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.817343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Security group rule updated ['053b8d58-809c-42fd-b227-a2106fd31162'] Sep 27 04:20:19.817983 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Resource SecurityGroupRule deleted: e33d2273-983a-4e06-aabc-0b41aafa91ec {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:19.818605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e33d2273-983a-4e06-aabc-0b41aafa91ec), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:19.819161 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8f6b6cf7-f0e8-4e59-b3cf-0f7433fc1d88 admin admin] Security group rule updated ['053b8d58-809c-42fd-b227-a2106fd31162'] Sep 27 04:20:20.166788 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Resource SecurityGroup deleted: f0452a84-e8c9-496b-af21-e94403e95e18 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:20.167172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (f0452a84-e8c9-496b-af21-e94403e95e18), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:20.167614 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f0452a84-e8c9-496b-af21-e94403e95e18',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:20.235076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f0452a84-e8c9-496b-af21-e94403e95e18',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:20.236568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Resource SecurityGroupRule deleted: 7b496824-dd18-4d15-b046-fe9f928adf28 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:20.237105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7b496824-dd18-4d15-b046-fe9f928adf28), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:20.237589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Security group rule updated ['f0452a84-e8c9-496b-af21-e94403e95e18'] Sep 27 04:20:20.238150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Resource SecurityGroupRule deleted: 92b3e76d-9327-49cc-bd4e-d573c1ca2f01 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:20.238649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (92b3e76d-9327-49cc-bd4e-d573c1ca2f01), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:20.239167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Security group rule updated ['f0452a84-e8c9-496b-af21-e94403e95e18'] Sep 27 04:20:20.239846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Resource SecurityGroupRule deleted: b2623013-9a33-401f-8ed1-34a1c0b8810a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:20.247091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b2623013-9a33-401f-8ed1-34a1c0b8810a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:20.247578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Security group rule updated ['f0452a84-e8c9-496b-af21-e94403e95e18'] Sep 27 04:20:20.247996 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Resource SecurityGroupRule deleted: c18d85a4-af2d-451d-a083-36eafbda4989 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:20.248357 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c18d85a4-af2d-451d-a083-36eafbda4989), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:20.251006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-234d426c-d332-4fc2-ba6b-12bdbb154686 admin admin] Security group rule updated ['f0452a84-e8c9-496b-af21-e94403e95e18'] Sep 27 04:20:20.445949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-299eca02-3086-4204-b2e0-5a4f384b4e52 None None] Resource Port d38ba25f-11e0-4272-a046-108afa9fa96c updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=d38ba25f-11e0-4272-a046-108afa9fa96c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=d38ba25f-11e0-4272-a046-108afa9fa96c,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=d38ba25f-11e0-4272-a046-108afa9fa96c,segment=NetworkSegment(188f0649-0d82-4591-a8be-8000cf940ed2),segment_id=188f0649-0d82-4591-a8be-8000cf940ed2)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:20.447415 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-299eca02-3086-4204-b2e0-5a4f384b4e52 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (d38ba25f-11e0-4272-a046-108afa9fa96c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:21.195668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:249 started Sep 27 04:20:21.200328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bd7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=24000000,duration_sec=511,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:21.201292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:21.203853 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:249 - starting polling. Elapsed:0.007 Sep 27 04:20:21.213254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:21.218581 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:249 - port information retrieved. Elapsed:0.018 Sep 27 04:20:21.219166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', '133717b2-0788-457d-9fba-bcfb1664cf21', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': set(), 'updated': {'d38ba25f-11e0-4272-a046-108afa9fa96c', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:20:21.222895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'device_id': '484d1f09-a6b1-4259-a367-00e5d24c5c04', 'network_id': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'port_id': 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'mac_address': 'fa:16:3e:e9:8a:fd', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7fbc1344-d37e-4e3c-8ea2-baced031ac4e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:21.225660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', 'device_id': '1570ff6f-8fc2-4463-9e5e-3ed7a777c891', 'network_id': '90468030-e15f-4d68-bea3-d020393e070f', 'port_id': '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', 'mac_address': 'fa:16:3e:ad:cb:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ef556055-3d79-4e00-91ba-4215c47f3d3a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:21.249006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: d38ba25f-11e0-4272-a046-108afa9fa96c {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:21.249006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port d38ba25f-11e0-4272-a046-108afa9fa96c updated. Details: {'device': 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'device_id': '484d1f09-a6b1-4259-a367-00e5d24c5c04', 'network_id': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'port_id': 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'mac_address': 'fa:16:3e:e9:8a:fd', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7fbc1344-d37e-4e3c-8ea2-baced031ac4e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Sep 27 04:20:21.254763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d38ba25f-11, col_values=(('tag', 6),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:21.256478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-d38ba25f-11, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:21.256891 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-d38ba25f-11, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:21.294568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d38ba25f-11, col_values=(('other_config', {'net_uuid': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '124'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:21.322215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bd9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:21.324356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:21.326287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 updated. Details: {'device': '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', 'device_id': '1570ff6f-8fc2-4463-9e5e-3ed7a777c891', 'network_id': '90468030-e15f-4d68-bea3-d020393e070f', 'port_id': '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', 'mac_address': 'fa:16:3e:ad:cb:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ef556055-3d79-4e00-91ba-4215c47f3d3a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Sep 27 04:20:21.331327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-5c3fe5c2-e2, col_values=(('tag', 5),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:21.334027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-5c3fe5c2-e2, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:21.335989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-5c3fe5c2-e2, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:21.338008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:21.340303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-5c3fe5c2-e2, col_values=(('other_config', {'net_uuid': '90468030-e15f-4d68-bea3-d020393e070f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '141', 'tag': '5'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:21.358969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:21.371860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bdb,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:21.376342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:249 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.156 Sep 27 04:20:21.376954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 2 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:20:21.377617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:20:21.386697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:21.389076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:21.412546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:21.565090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[033408f0-b25c-428f-97cb-b31ede619409]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:21.566758 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:249 - agent port security group processed in 0.347 Sep 27 04:20:21.567848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for d38ba25f-11e0-4272-a046-108afa9fa96c to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:21.568530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:22.034446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:21Z,description='Default security group',id=93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452,is_default=True,name='default',project_id='df06e8751c89418db5fb916f63cac9d8',revision_number=1,rules=[SecurityGroupRule(80e32c0b-2834-4305-b15e-db8adf670911),SecurityGroupRule(ba69fff4-dad7-4bed-9a3e-11587192e307),SecurityGroupRule(c0af1e99-8ec6-4f65-a4e5-6bd47ecb66ee),SecurityGroupRule(eaaeb41d-87ec-47a9-bb22-d37e31f5f330)],shared=False,stateful=True,updated_at=2022-09-27T04:20:21Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:22.036174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.037027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:21Z,description=,direction='egress',ethertype='IPv4',id=80e32c0b-2834-4305-b15e-db8adf670911,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df06e8751c89418db5fb916f63cac9d8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452,updated_at=2022-09-27T04:20:21Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:22.037969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (80e32c0b-2834-4305-b15e-db8adf670911), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.038511 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Security group rule updated ['93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452'] Sep 27 04:20:22.039990 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:21Z,description=,direction='ingress',ethertype='IPv4',id=ba69fff4-dad7-4bed-9a3e-11587192e307,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df06e8751c89418db5fb916f63cac9d8',protocol=,remote_address_group_id=,remote_group_id=93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452,remote_ip_prefix=,revision_number=0,security_group_id=93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452,updated_at=2022-09-27T04:20:21Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:22.040588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ba69fff4-dad7-4bed-9a3e-11587192e307), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.045792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Security group rule updated ['93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452'] Sep 27 04:20:22.047697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:21Z,description=,direction='egress',ethertype='IPv6',id=c0af1e99-8ec6-4f65-a4e5-6bd47ecb66ee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df06e8751c89418db5fb916f63cac9d8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452,updated_at=2022-09-27T04:20:21Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:22.048295 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c0af1e99-8ec6-4f65-a4e5-6bd47ecb66ee), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.050480 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Security group rule updated ['93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452'] Sep 27 04:20:22.051682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:21Z,description=,direction='ingress',ethertype='IPv6',id=eaaeb41d-87ec-47a9-bb22-d37e31f5f330,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df06e8751c89418db5fb916f63cac9d8',protocol=,remote_address_group_id=,remote_group_id=93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452,remote_ip_prefix=,revision_number=0,security_group_id=93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452,updated_at=2022-09-27T04:20:21Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:22.054442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (eaaeb41d-87ec-47a9-bb22-d37e31f5f330), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.054949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-487d2f28-0b01-408d-b29a-b2381a329df3 admin admin] Security group rule updated ['93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452'] Sep 27 04:20:22.640469 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Resource SecurityGroup deleted: 93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:22.642486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.648649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:22.735529 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-84210ade-33a1-4a55-9855-6dba13adb6f5 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:19Z,data_plane_status=None,description='',device_id='e24dba8d-ecd7-482f-9c93-79e714785fec',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ef3b9eed-fccf-490a-bc0f-2fe41f79b621,mac_address=fa:16:3e:e5:f3:1a,name='',network_id=a72f6105-d258-45cb-a84d-18590bef93c2,numa_affinity_policy=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ef3b9eed-fccf-490a-bc0f-2fe41f79b621),security_group_ids=set([62743add-abd0-40c3-a1bc-b77cc5f58cd6]),status='DOWN',updated_at=2022-09-27T04:20:20Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:22.735960 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-84210ade-33a1-4a55-9855-6dba13adb6f5 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ef3b9eed-fccf-490a-bc0f-2fe41f79b621), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.736390 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-84210ade-33a1-4a55-9855-6dba13adb6f5 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group member updated {'62743add-abd0-40c3-a1bc-b77cc5f58cd6'} Sep 27 04:20:22.758868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:22.763137 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Resource SecurityGroupRule deleted: 80e32c0b-2834-4305-b15e-db8adf670911 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:22.763779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (80e32c0b-2834-4305-b15e-db8adf670911), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.773638 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Security group rule updated ['93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452'] Sep 27 04:20:22.774701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Resource SecurityGroupRule deleted: ba69fff4-dad7-4bed-9a3e-11587192e307 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:22.783396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ba69fff4-dad7-4bed-9a3e-11587192e307), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.783396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Security group rule updated ['93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452'] Sep 27 04:20:22.783396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Resource SecurityGroupRule deleted: c0af1e99-8ec6-4f65-a4e5-6bd47ecb66ee {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:22.783396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c0af1e99-8ec6-4f65-a4e5-6bd47ecb66ee), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.783396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Security group rule updated ['93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452'] Sep 27 04:20:22.783777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Resource SecurityGroupRule deleted: eaaeb41d-87ec-47a9-bb22-d37e31f5f330 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:22.783777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (eaaeb41d-87ec-47a9-bb22-d37e31f5f330), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:22.783777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d0058835-72c2-4b27-892f-11db3cbfbf38 admin admin] Security group rule updated ['93dc8e1d-ced9-4d80-9c3a-e37aa4bb6452'] Sep 27 04:20:22.877707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port d38ba25f-11e0-4272-a046-108afa9fa96c updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:22.878206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (d38ba25f-11e0-4272-a046-108afa9fa96c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:23.267965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f9ca79f9-a60e-4603-b0e5-5ac55dd0027e service neutron] Resource Port acd21fd8-866c-4c10-9697-2fe37ef43cf1 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=acd21fd8-866c-4c10-9697-2fe37ef43cf1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=acd21fd8-866c-4c10-9697-2fe37ef43cf1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:23.268628 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f9ca79f9-a60e-4603-b0e5-5ac55dd0027e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (acd21fd8-866c-4c10-9697-2fe37ef43cf1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:23.406001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['d38ba25f-11e0-4272-a046-108afa9fa96c', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'] and devices down [] completed. Sep 27 04:20:23.406334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:249 - ports processed. Elapsed:2.211 Sep 27 04:20:23.406745 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:249 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:2.211 Sep 27 04:20:23.407793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Loop iteration exceeded interval (2 vs. 2.211373805999756)! {{(pid=107232) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 27 04:20:23.408219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:250 started Sep 27 04:20:23.411793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bdd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=235000000,duration_sec=513,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:23.412440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:23.413077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:250 - starting polling. Elapsed:0.005 Sep 27 04:20:23.415581 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:23.432764 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:250 - port information retrieved. Elapsed:0.020 Sep 27 04:20:23.433196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87', '133717b2-0788-457d-9fba-bcfb1664cf21', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': set(), 'updated': {'d38ba25f-11e0-4272-a046-108afa9fa96c'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:20:23.433802 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'device_id': '484d1f09-a6b1-4259-a367-00e5d24c5c04', 'network_id': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'port_id': 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'mac_address': 'fa:16:3e:e9:8a:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7fbc1344-d37e-4e3c-8ea2-baced031ac4e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:20:23.445231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: d38ba25f-11e0-4272-a046-108afa9fa96c {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:20:23.445792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port d38ba25f-11e0-4272-a046-108afa9fa96c updated. Details: {'device': 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'device_id': '484d1f09-a6b1-4259-a367-00e5d24c5c04', 'network_id': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'port_id': 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'mac_address': 'fa:16:3e:e9:8a:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7fbc1344-d37e-4e3c-8ea2-baced031ac4e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Sep 27 04:20:23.451779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d38ba25f-11, col_values=(('tag', 6),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:23.455208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-d38ba25f-11, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:23.456573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-d38ba25f-11, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:23.458049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:23.463355 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d38ba25f-11, col_values=(('other_config', {'net_uuid': '50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '124', 'tag': '6'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:20:23.468134 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:20:23.474183 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22bdf,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:23.478654 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:250 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.045 Sep 27 04:20:23.480454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:20:23.481477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:20:23.489670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:20:23.490056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:20:23.495283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:20:23.614883 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f90d3d3-875a-4d9e-9396-d265257fa01d]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:20:23.615558 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:250 - agent port security group processed in 0.182 Sep 27 04:20:23.616271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for d38ba25f-11e0-4272-a046-108afa9fa96c to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:20:24.244735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['d38ba25f-11e0-4272-a046-108afa9fa96c'] and devices down [] completed. Sep 27 04:20:24.246025 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:250 - ports processed. Elapsed:0.838 Sep 27 04:20:24.246582 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:250 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.838 Sep 27 04:20:24.666391 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8dd871d3-9444-4000-bc2c-1094259bf9ef service neutron] Resource Port ef3b9eed-fccf-490a-bc0f-2fe41f79b621 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=ef3b9eed-fccf-490a-bc0f-2fe41f79b621,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=ef3b9eed-fccf-490a-bc0f-2fe41f79b621,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:24.666865 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8dd871d3-9444-4000-bc2c-1094259bf9ef service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ef3b9eed-fccf-490a-bc0f-2fe41f79b621), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:25.409562 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:251 started Sep 27 04:20:25.414028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22be1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=237000000,duration_sec=515,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:25.414889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:25.415395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:251 - starting polling. Elapsed:0.006 Sep 27 04:20:25.417944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:25.421790 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:251 - port information retrieved. Elapsed:0.011 Sep 27 04:20:25.422287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:251 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 27 04:20:26.112304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f9ca79f9-a60e-4603-b0e5-5ac55dd0027e service neutron] Resource Port acd21fd8-866c-4c10-9697-2fe37ef43cf1 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=acd21fd8-866c-4c10-9697-2fe37ef43cf1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=acd21fd8-866c-4c10-9697-2fe37ef43cf1,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=acd21fd8-866c-4c10-9697-2fe37ef43cf1,segment=NetworkSegment(140b4dbd-c7b9-40d2-9281-c4e4b44aa6c5),segment_id=140b4dbd-c7b9-40d2-9281-c4e4b44aa6c5)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:26.112700 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f9ca79f9-a60e-4603-b0e5-5ac55dd0027e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (acd21fd8-866c-4c10-9697-2fe37ef43cf1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:26.264075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fb1a8110-5774-4137-8536-cc7bef570b53 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:20:23Z,data_plane_status=None,description='',device_id='333a79d8-9886-4cc6-bbd4-335bee1d98b6',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=bbab3923-3dca-428e-93ca-c5dd6eb5cde9,mac_address=fa:16:3e:5a:77:6d,name='',network_id=50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6,numa_affinity_policy=,project_id='312fa89a4d9b43c5919b7bad5411002a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(bbab3923-3dca-428e-93ca-c5dd6eb5cde9),security_group_ids=set([34ffa770-a7d9-4d84-9c61-d25f5aba0345]),status='DOWN',updated_at=2022-09-27T04:20:24Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:26.265314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fb1a8110-5774-4137-8536-cc7bef570b53 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:26.266281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fb1a8110-5774-4137-8536-cc7bef570b53 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group member updated {'34ffa770-a7d9-4d84-9c61-d25f5aba0345'} Sep 27 04:20:26.714816 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8dd871d3-9444-4000-bc2c-1094259bf9ef service neutron] Resource Port ef3b9eed-fccf-490a-bc0f-2fe41f79b621 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=ef3b9eed-fccf-490a-bc0f-2fe41f79b621,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=ef3b9eed-fccf-490a-bc0f-2fe41f79b621,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=ef3b9eed-fccf-490a-bc0f-2fe41f79b621,segment=NetworkSegment(a913cdfa-72ec-4cc3-8b5c-57a3fb6a0921),segment_id=a913cdfa-72ec-4cc3-8b5c-57a3fb6a0921)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:26.715437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8dd871d3-9444-4000-bc2c-1094259bf9ef service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ef3b9eed-fccf-490a-bc0f-2fe41f79b621), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:27.428580 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:252 started Sep 27 04:20:27.435465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22be3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=257000000,duration_sec=517,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:27.438944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:27.440309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:252 - starting polling. Elapsed:0.023 Sep 27 04:20:27.447204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:27.456024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:252 - port information retrieved. Elapsed:0.039 Sep 27 04:20:27.461365 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:252 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.044 Sep 27 04:20:28.437323 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c2bdd3b3-6822-4516-9e69-cd32f05a58cb service neutron] Resource Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=bbab3923-3dca-428e-93ca-c5dd6eb5cde9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=bbab3923-3dca-428e-93ca-c5dd6eb5cde9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:28.438668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c2bdd3b3-6822-4516-9e69-cd32f05a58cb service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:29.419865 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:253 started Sep 27 04:20:29.423218 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22be5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=247000000,duration_sec=519,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:29.424020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:29.424813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:253 - starting polling. Elapsed:0.005 Sep 27 04:20:29.427158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:29.434737 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:253 - port information retrieved. Elapsed:0.013 Sep 27 04:20:29.436096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:253 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 27 04:20:29.788273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c2bdd3b3-6822-4516-9e69-cd32f05a58cb service neutron] Resource Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=bbab3923-3dca-428e-93ca-c5dd6eb5cde9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=bbab3923-3dca-428e-93ca-c5dd6eb5cde9,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=bbab3923-3dca-428e-93ca-c5dd6eb5cde9,segment=NetworkSegment(188f0649-0d82-4591-a8be-8000cf940ed2),segment_id=188f0649-0d82-4591-a8be-8000cf940ed2)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:29.790028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c2bdd3b3-6822-4516-9e69-cd32f05a58cb service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.053476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:28Z,description='Default security group',id=51d66f81-3a03-442d-b42e-642b64bc8a64,is_default=True,name='default',project_id='52f37847ffde4c47a8716bff540866c1',revision_number=1,rules=[SecurityGroupRule(2f6df23f-2150-44af-a59f-c5aa41fba6f8),SecurityGroupRule(38ff8b70-fe43-4305-a1c7-a1a5e07eaa89),SecurityGroupRule(7f0f1501-1d2b-4deb-bfdc-822ccf9683b4),SecurityGroupRule(e6650384-6800-4b8b-9643-d2160b5fc760)],shared=False,stateful=True,updated_at=2022-09-27T04:20:28Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.054227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (51d66f81-3a03-442d-b42e-642b64bc8a64), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.055601 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:29Z,description=,direction='egress',ethertype='IPv4',id=2f6df23f-2150-44af-a59f-c5aa41fba6f8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52f37847ffde4c47a8716bff540866c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=51d66f81-3a03-442d-b42e-642b64bc8a64,updated_at=2022-09-27T04:20:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.056315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2f6df23f-2150-44af-a59f-c5aa41fba6f8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.057054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Security group rule updated ['51d66f81-3a03-442d-b42e-642b64bc8a64'] Sep 27 04:20:30.058290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:29Z,description=,direction='ingress',ethertype='IPv6',id=38ff8b70-fe43-4305-a1c7-a1a5e07eaa89,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52f37847ffde4c47a8716bff540866c1',protocol=,remote_address_group_id=,remote_group_id=51d66f81-3a03-442d-b42e-642b64bc8a64,remote_ip_prefix=,revision_number=0,security_group_id=51d66f81-3a03-442d-b42e-642b64bc8a64,updated_at=2022-09-27T04:20:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.058922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (38ff8b70-fe43-4305-a1c7-a1a5e07eaa89), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.059467 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Security group rule updated ['51d66f81-3a03-442d-b42e-642b64bc8a64'] Sep 27 04:20:30.060585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:29Z,description=,direction='egress',ethertype='IPv6',id=7f0f1501-1d2b-4deb-bfdc-822ccf9683b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52f37847ffde4c47a8716bff540866c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=51d66f81-3a03-442d-b42e-642b64bc8a64,updated_at=2022-09-27T04:20:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.062916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7f0f1501-1d2b-4deb-bfdc-822ccf9683b4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.064721 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Security group rule updated ['51d66f81-3a03-442d-b42e-642b64bc8a64'] Sep 27 04:20:30.072813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:28Z,description=,direction='ingress',ethertype='IPv4',id=e6650384-6800-4b8b-9643-d2160b5fc760,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52f37847ffde4c47a8716bff540866c1',protocol=,remote_address_group_id=,remote_group_id=51d66f81-3a03-442d-b42e-642b64bc8a64,remote_ip_prefix=,revision_number=0,security_group_id=51d66f81-3a03-442d-b42e-642b64bc8a64,updated_at=2022-09-27T04:20:28Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.073621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e6650384-6800-4b8b-9643-d2160b5fc760), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.074161 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-57874ff1-c5b3-4be6-a315-9bc95747e7ed admin admin] Security group rule updated ['51d66f81-3a03-442d-b42e-642b64bc8a64'] Sep 27 04:20:30.399861 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:29Z,description='Default security group',id=40bb5952-e05a-4f92-a532-d8bc1427e38b,is_default=True,name='default',project_id='793630bfbb45489ebfb216dbb8f692a7',revision_number=1,rules=[SecurityGroupRule(1e006831-769e-4963-8619-292219a45d4b),SecurityGroupRule(3dafe6ed-d4dd-4fb0-a429-4c361ffc0893),SecurityGroupRule(42164277-a1ff-45be-94f8-c9746053135a),SecurityGroupRule(ebdf0577-05c9-4bfc-938d-87f94e0de208)],shared=False,stateful=True,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.400489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (40bb5952-e05a-4f92-a532-d8bc1427e38b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.402311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='egress',ethertype='IPv6',id=1e006831-769e-4963-8619-292219a45d4b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='793630bfbb45489ebfb216dbb8f692a7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=40bb5952-e05a-4f92-a532-d8bc1427e38b,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.403401 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1e006831-769e-4963-8619-292219a45d4b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.404034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Security group rule updated ['40bb5952-e05a-4f92-a532-d8bc1427e38b'] Sep 27 04:20:30.407871 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='ingress',ethertype='IPv6',id=3dafe6ed-d4dd-4fb0-a429-4c361ffc0893,normalized_cidr=None,port_range_max=,port_range_min=,project_id='793630bfbb45489ebfb216dbb8f692a7',protocol=,remote_address_group_id=,remote_group_id=40bb5952-e05a-4f92-a532-d8bc1427e38b,remote_ip_prefix=,revision_number=0,security_group_id=40bb5952-e05a-4f92-a532-d8bc1427e38b,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.408512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3dafe6ed-d4dd-4fb0-a429-4c361ffc0893), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.409177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Security group rule updated ['40bb5952-e05a-4f92-a532-d8bc1427e38b'] Sep 27 04:20:30.411090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='egress',ethertype='IPv4',id=42164277-a1ff-45be-94f8-c9746053135a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='793630bfbb45489ebfb216dbb8f692a7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=40bb5952-e05a-4f92-a532-d8bc1427e38b,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.411619 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (42164277-a1ff-45be-94f8-c9746053135a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.411978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Security group rule updated ['40bb5952-e05a-4f92-a532-d8bc1427e38b'] Sep 27 04:20:30.412689 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:29Z,description=,direction='ingress',ethertype='IPv4',id=ebdf0577-05c9-4bfc-938d-87f94e0de208,normalized_cidr=None,port_range_max=,port_range_min=,project_id='793630bfbb45489ebfb216dbb8f692a7',protocol=,remote_address_group_id=,remote_group_id=40bb5952-e05a-4f92-a532-d8bc1427e38b,remote_ip_prefix=,revision_number=0,security_group_id=40bb5952-e05a-4f92-a532-d8bc1427e38b,updated_at=2022-09-27T04:20:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.413104 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ebdf0577-05c9-4bfc-938d-87f94e0de208), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.413444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1e88b514-a980-403f-8515-d92352cae3d5 admin admin] Security group rule updated ['40bb5952-e05a-4f92-a532-d8bc1427e38b'] Sep 27 04:20:30.489591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:30Z,description='Default security group',id=fc3316ee-92c1-4fa5-8c0d-faa525db9f68,is_default=True,name='default',project_id='5cfa4aef4d854659b5d79e40bb849bc1',revision_number=1,rules=[SecurityGroupRule(57598e2a-68fd-43bc-ac77-f52015c12917),SecurityGroupRule(8e63a09b-fe15-4471-abec-eda190375f62),SecurityGroupRule(a10f95f1-5157-4084-be04-9f0d03b254bd),SecurityGroupRule(e48e2fcb-2340-4c5e-9285-d928c3be31c8)],shared=False,stateful=True,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.490041 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (fc3316ee-92c1-4fa5-8c0d-faa525db9f68), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.490819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='egress',ethertype='IPv6',id=57598e2a-68fd-43bc-ac77-f52015c12917,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5cfa4aef4d854659b5d79e40bb849bc1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fc3316ee-92c1-4fa5-8c0d-faa525db9f68,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.491242 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (57598e2a-68fd-43bc-ac77-f52015c12917), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.491897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Security group rule updated ['fc3316ee-92c1-4fa5-8c0d-faa525db9f68'] Sep 27 04:20:30.494120 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='ingress',ethertype='IPv6',id=8e63a09b-fe15-4471-abec-eda190375f62,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5cfa4aef4d854659b5d79e40bb849bc1',protocol=,remote_address_group_id=,remote_group_id=fc3316ee-92c1-4fa5-8c0d-faa525db9f68,remote_ip_prefix=,revision_number=0,security_group_id=fc3316ee-92c1-4fa5-8c0d-faa525db9f68,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.494494 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8e63a09b-fe15-4471-abec-eda190375f62), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.494825 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Security group rule updated ['fc3316ee-92c1-4fa5-8c0d-faa525db9f68'] Sep 27 04:20:30.495675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='ingress',ethertype='IPv4',id=a10f95f1-5157-4084-be04-9f0d03b254bd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5cfa4aef4d854659b5d79e40bb849bc1',protocol=,remote_address_group_id=,remote_group_id=fc3316ee-92c1-4fa5-8c0d-faa525db9f68,remote_ip_prefix=,revision_number=0,security_group_id=fc3316ee-92c1-4fa5-8c0d-faa525db9f68,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.496079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a10f95f1-5157-4084-be04-9f0d03b254bd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.496417 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Security group rule updated ['fc3316ee-92c1-4fa5-8c0d-faa525db9f68'] Sep 27 04:20:30.497157 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='egress',ethertype='IPv4',id=e48e2fcb-2340-4c5e-9285-d928c3be31c8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5cfa4aef4d854659b5d79e40bb849bc1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fc3316ee-92c1-4fa5-8c0d-faa525db9f68,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.497610 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e48e2fcb-2340-4c5e-9285-d928c3be31c8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.498013 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-96e3c742-9797-4a4f-8d3f-26a49cae1b25 admin admin] Security group rule updated ['fc3316ee-92c1-4fa5-8c0d-faa525db9f68'] Sep 27 04:20:30.576959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Resource SecurityGroup deleted: 51d66f81-3a03-442d-b42e-642b64bc8a64 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.578241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (51d66f81-3a03-442d-b42e-642b64bc8a64), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.579694 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('51d66f81-3a03-442d-b42e-642b64bc8a64',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:30.601881 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('51d66f81-3a03-442d-b42e-642b64bc8a64',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:30.602819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Resource SecurityGroupRule deleted: 2f6df23f-2150-44af-a59f-c5aa41fba6f8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.605588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2f6df23f-2150-44af-a59f-c5aa41fba6f8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.606205 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Security group rule updated ['51d66f81-3a03-442d-b42e-642b64bc8a64'] Sep 27 04:20:30.606907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Resource SecurityGroupRule deleted: 38ff8b70-fe43-4305-a1c7-a1a5e07eaa89 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.607865 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (38ff8b70-fe43-4305-a1c7-a1a5e07eaa89), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.611037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Security group rule updated ['51d66f81-3a03-442d-b42e-642b64bc8a64'] Sep 27 04:20:30.611855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Resource SecurityGroupRule deleted: 7f0f1501-1d2b-4deb-bfdc-822ccf9683b4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.613383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7f0f1501-1d2b-4deb-bfdc-822ccf9683b4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.614127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Security group rule updated ['51d66f81-3a03-442d-b42e-642b64bc8a64'] Sep 27 04:20:30.615426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Resource SecurityGroupRule deleted: e6650384-6800-4b8b-9643-d2160b5fc760 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.616435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e6650384-6800-4b8b-9643-d2160b5fc760), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.618091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d3dc31a5-3a7d-490f-ae76-a3d7a7f225ab admin admin] Security group rule updated ['51d66f81-3a03-442d-b42e-642b64bc8a64'] Sep 27 04:20:30.687170 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Resource SecurityGroup deleted: 40bb5952-e05a-4f92-a532-d8bc1427e38b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.687740 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (40bb5952-e05a-4f92-a532-d8bc1427e38b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.688562 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('40bb5952-e05a-4f92-a532-d8bc1427e38b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:30.704942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('40bb5952-e05a-4f92-a532-d8bc1427e38b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:30.705405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Resource SecurityGroupRule deleted: 1e006831-769e-4963-8619-292219a45d4b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.705827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1e006831-769e-4963-8619-292219a45d4b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.706178 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Security group rule updated ['40bb5952-e05a-4f92-a532-d8bc1427e38b'] Sep 27 04:20:30.706582 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Resource SecurityGroupRule deleted: 3dafe6ed-d4dd-4fb0-a429-4c361ffc0893 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.706926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3dafe6ed-d4dd-4fb0-a429-4c361ffc0893), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.707682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Security group rule updated ['40bb5952-e05a-4f92-a532-d8bc1427e38b'] Sep 27 04:20:30.708325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Resource SecurityGroupRule deleted: 42164277-a1ff-45be-94f8-c9746053135a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.708684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (42164277-a1ff-45be-94f8-c9746053135a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.708988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Security group rule updated ['40bb5952-e05a-4f92-a532-d8bc1427e38b'] Sep 27 04:20:30.709373 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Resource SecurityGroupRule deleted: ebdf0577-05c9-4bfc-938d-87f94e0de208 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.709691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ebdf0577-05c9-4bfc-938d-87f94e0de208), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.710227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b8cde558-44a5-4df9-a8db-17146e047bd0 admin admin] Security group rule updated ['40bb5952-e05a-4f92-a532-d8bc1427e38b'] Sep 27 04:20:30.723571 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Resource SecurityGroup deleted: fc3316ee-92c1-4fa5-8c0d-faa525db9f68 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.724227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (fc3316ee-92c1-4fa5-8c0d-faa525db9f68), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.725054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fc3316ee-92c1-4fa5-8c0d-faa525db9f68',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:30.739480 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fc3316ee-92c1-4fa5-8c0d-faa525db9f68',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:30.739932 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Resource SecurityGroupRule deleted: 57598e2a-68fd-43bc-ac77-f52015c12917 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.740299 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (57598e2a-68fd-43bc-ac77-f52015c12917), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.740686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Security group rule updated ['fc3316ee-92c1-4fa5-8c0d-faa525db9f68'] Sep 27 04:20:30.741088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Resource SecurityGroupRule deleted: 8e63a09b-fe15-4471-abec-eda190375f62 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.741590 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (8e63a09b-fe15-4471-abec-eda190375f62), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.741985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Security group rule updated ['fc3316ee-92c1-4fa5-8c0d-faa525db9f68'] Sep 27 04:20:30.742360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Resource SecurityGroupRule deleted: a10f95f1-5157-4084-be04-9f0d03b254bd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.742854 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a10f95f1-5157-4084-be04-9f0d03b254bd), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.743181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Security group rule updated ['fc3316ee-92c1-4fa5-8c0d-faa525db9f68'] Sep 27 04:20:30.743547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Resource SecurityGroupRule deleted: e48e2fcb-2340-4c5e-9285-d928c3be31c8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.743997 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e48e2fcb-2340-4c5e-9285-d928c3be31c8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.744201 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2ab20702-0ad8-4da1-9604-b9a8013c7602 admin admin] Security group rule updated ['fc3316ee-92c1-4fa5-8c0d-faa525db9f68'] Sep 27 04:20:30.865254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:30Z,description='Default security group',id=3b42c918-14c3-47ec-915f-f7b72ec0fe0b,is_default=True,name='default',project_id='1abc25ba289d49f285f776cd65e3e3ea',revision_number=1,rules=[SecurityGroupRule(2a8fde40-e7e9-483d-a6b8-27c4e44747a8),SecurityGroupRule(32554af9-d8a3-42f7-9672-3a2777d5f12c),SecurityGroupRule(3cdfa6f4-dabd-4e17-a17c-cff6d982d033),SecurityGroupRule(4dd7bdd8-4811-499b-9b6f-72257c3c03ee)],shared=False,stateful=True,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.866452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (3b42c918-14c3-47ec-915f-f7b72ec0fe0b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.869087 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='egress',ethertype='IPv4',id=2a8fde40-e7e9-483d-a6b8-27c4e44747a8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1abc25ba289d49f285f776cd65e3e3ea',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3b42c918-14c3-47ec-915f-f7b72ec0fe0b,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.878496 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2a8fde40-e7e9-483d-a6b8-27c4e44747a8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.879042 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Security group rule updated ['3b42c918-14c3-47ec-915f-f7b72ec0fe0b'] Sep 27 04:20:30.882378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='ingress',ethertype='IPv6',id=32554af9-d8a3-42f7-9672-3a2777d5f12c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1abc25ba289d49f285f776cd65e3e3ea',protocol=,remote_address_group_id=,remote_group_id=3b42c918-14c3-47ec-915f-f7b72ec0fe0b,remote_ip_prefix=,revision_number=0,security_group_id=3b42c918-14c3-47ec-915f-f7b72ec0fe0b,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.883473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (32554af9-d8a3-42f7-9672-3a2777d5f12c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.884433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Security group rule updated ['3b42c918-14c3-47ec-915f-f7b72ec0fe0b'] Sep 27 04:20:30.886897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='ingress',ethertype='IPv4',id=3cdfa6f4-dabd-4e17-a17c-cff6d982d033,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1abc25ba289d49f285f776cd65e3e3ea',protocol=,remote_address_group_id=,remote_group_id=3b42c918-14c3-47ec-915f-f7b72ec0fe0b,remote_ip_prefix=,revision_number=0,security_group_id=3b42c918-14c3-47ec-915f-f7b72ec0fe0b,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.888040 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3cdfa6f4-dabd-4e17-a17c-cff6d982d033), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.891426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Security group rule updated ['3b42c918-14c3-47ec-915f-f7b72ec0fe0b'] Sep 27 04:20:30.895839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:30Z,description=,direction='egress',ethertype='IPv6',id=4dd7bdd8-4811-499b-9b6f-72257c3c03ee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1abc25ba289d49f285f776cd65e3e3ea',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3b42c918-14c3-47ec-915f-f7b72ec0fe0b,updated_at=2022-09-27T04:20:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:30.897476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4dd7bdd8-4811-499b-9b6f-72257c3c03ee), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.900682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e9e2656c-8fb5-454c-9f4d-abdc4eaaf3f6 admin admin] Security group rule updated ['3b42c918-14c3-47ec-915f-f7b72ec0fe0b'] Sep 27 04:20:30.922046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Resource SecurityGroup deleted: 3b42c918-14c3-47ec-915f-f7b72ec0fe0b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.922443 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (3b42c918-14c3-47ec-915f-f7b72ec0fe0b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.922919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3b42c918-14c3-47ec-915f-f7b72ec0fe0b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:30.937671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3b42c918-14c3-47ec-915f-f7b72ec0fe0b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:30.938139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Resource SecurityGroupRule deleted: 2a8fde40-e7e9-483d-a6b8-27c4e44747a8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.938528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2a8fde40-e7e9-483d-a6b8-27c4e44747a8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.938878 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Security group rule updated ['3b42c918-14c3-47ec-915f-f7b72ec0fe0b'] Sep 27 04:20:30.939262 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Resource SecurityGroupRule deleted: 32554af9-d8a3-42f7-9672-3a2777d5f12c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.939631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (32554af9-d8a3-42f7-9672-3a2777d5f12c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.939959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Security group rule updated ['3b42c918-14c3-47ec-915f-f7b72ec0fe0b'] Sep 27 04:20:30.940336 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Resource SecurityGroupRule deleted: 3cdfa6f4-dabd-4e17-a17c-cff6d982d033 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.940684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3cdfa6f4-dabd-4e17-a17c-cff6d982d033), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.941008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Security group rule updated ['3b42c918-14c3-47ec-915f-f7b72ec0fe0b'] Sep 27 04:20:30.941383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Resource SecurityGroupRule deleted: 4dd7bdd8-4811-499b-9b6f-72257c3c03ee {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:30.942137 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4dd7bdd8-4811-499b-9b6f-72257c3c03ee), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:30.947990 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3450793c-eb19-4825-82b1-8b5f6532cc7b admin admin] Security group rule updated ['3b42c918-14c3-47ec-915f-f7b72ec0fe0b'] Sep 27 04:20:31.408022 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:31Z,description='Default security group',id=303491c2-fcfd-4f9e-af48-2757649f822e,is_default=True,name='default',project_id='d7f601e71ace4199be72b41bba1bbe83',revision_number=1,rules=[SecurityGroupRule(19fe846b-95b3-4427-80e9-212bbeaa95ac),SecurityGroupRule(ad16a318-1cea-4f2a-be1b-b210c491b3a1),SecurityGroupRule(e5680da1-4096-486a-a64f-2af76fc8f2cc),SecurityGroupRule(eb05e174-e04a-4838-8e23-73cd7569ccb6)],shared=False,stateful=True,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:31.408951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (303491c2-fcfd-4f9e-af48-2757649f822e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.410128 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='ingress',ethertype='IPv4',id=19fe846b-95b3-4427-80e9-212bbeaa95ac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7f601e71ace4199be72b41bba1bbe83',protocol=,remote_address_group_id=,remote_group_id=303491c2-fcfd-4f9e-af48-2757649f822e,remote_ip_prefix=,revision_number=0,security_group_id=303491c2-fcfd-4f9e-af48-2757649f822e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:31.411093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (19fe846b-95b3-4427-80e9-212bbeaa95ac), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.412456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Security group rule updated ['303491c2-fcfd-4f9e-af48-2757649f822e'] Sep 27 04:20:31.413379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='egress',ethertype='IPv6',id=ad16a318-1cea-4f2a-be1b-b210c491b3a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7f601e71ace4199be72b41bba1bbe83',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=303491c2-fcfd-4f9e-af48-2757649f822e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:31.414345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ad16a318-1cea-4f2a-be1b-b210c491b3a1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.415609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Security group rule updated ['303491c2-fcfd-4f9e-af48-2757649f822e'] Sep 27 04:20:31.418235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='ingress',ethertype='IPv6',id=e5680da1-4096-486a-a64f-2af76fc8f2cc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7f601e71ace4199be72b41bba1bbe83',protocol=,remote_address_group_id=,remote_group_id=303491c2-fcfd-4f9e-af48-2757649f822e,remote_ip_prefix=,revision_number=0,security_group_id=303491c2-fcfd-4f9e-af48-2757649f822e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:31.420386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e5680da1-4096-486a-a64f-2af76fc8f2cc), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.422070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Security group rule updated ['303491c2-fcfd-4f9e-af48-2757649f822e'] Sep 27 04:20:31.424657 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='egress',ethertype='IPv4',id=eb05e174-e04a-4838-8e23-73cd7569ccb6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7f601e71ace4199be72b41bba1bbe83',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=303491c2-fcfd-4f9e-af48-2757649f822e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:31.427250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (eb05e174-e04a-4838-8e23-73cd7569ccb6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.428486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c42db085-9ad9-45a5-a39e-9e8b2ff66f43 admin admin] Security group rule updated ['303491c2-fcfd-4f9e-af48-2757649f822e'] Sep 27 04:20:31.431371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:254 started Sep 27 04:20:31.445243 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22be7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=262000000,duration_sec=521,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:31.445923 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:31.448158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:254 - starting polling. Elapsed:0.017 Sep 27 04:20:31.460479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.474043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:254 - port information retrieved. Elapsed:0.040 Sep 27 04:20:31.476840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:254 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.043 Sep 27 04:20:31.604110 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Resource SecurityGroup deleted: 303491c2-fcfd-4f9e-af48-2757649f822e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:31.604498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (303491c2-fcfd-4f9e-af48-2757649f822e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.604971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('303491c2-fcfd-4f9e-af48-2757649f822e',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:31.621260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('303491c2-fcfd-4f9e-af48-2757649f822e',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:31.621714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Resource SecurityGroupRule deleted: 19fe846b-95b3-4427-80e9-212bbeaa95ac {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:31.622347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (19fe846b-95b3-4427-80e9-212bbeaa95ac), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.622688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Security group rule updated ['303491c2-fcfd-4f9e-af48-2757649f822e'] Sep 27 04:20:31.623092 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Resource SecurityGroupRule deleted: ad16a318-1cea-4f2a-be1b-b210c491b3a1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:31.623446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ad16a318-1cea-4f2a-be1b-b210c491b3a1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.623770 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Security group rule updated ['303491c2-fcfd-4f9e-af48-2757649f822e'] Sep 27 04:20:31.624196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Resource SecurityGroupRule deleted: e5680da1-4096-486a-a64f-2af76fc8f2cc {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:31.626254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e5680da1-4096-486a-a64f-2af76fc8f2cc), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.626487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Security group rule updated ['303491c2-fcfd-4f9e-af48-2757649f822e'] Sep 27 04:20:31.626868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Resource SecurityGroupRule deleted: eb05e174-e04a-4838-8e23-73cd7569ccb6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:31.627216 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (eb05e174-e04a-4838-8e23-73cd7569ccb6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.627541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-05396de3-281f-4c1a-ac22-eabd06a5c96a admin admin] Security group rule updated ['303491c2-fcfd-4f9e-af48-2757649f822e'] Sep 27 04:20:31.793651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:31Z,description='Default security group',id=ad4d8177-41dd-49bf-80c7-a10dc4c6b01b,is_default=True,name='default',project_id='a6722e737b85493db74fd654f295f79d',revision_number=1,rules=[SecurityGroupRule(23f12ac1-c28c-42e1-a2f5-8aba940e809d),SecurityGroupRule(a504b9ce-6939-4a10-8b47-acc40a4afbea),SecurityGroupRule(aa0b8581-3438-4730-8f69-17754ca26ff5),SecurityGroupRule(c5ee6a89-3c4e-41dd-9726-c255b7864b9b)],shared=False,stateful=True,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:31.794207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (ad4d8177-41dd-49bf-80c7-a10dc4c6b01b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.795123 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='egress',ethertype='IPv6',id=23f12ac1-c28c-42e1-a2f5-8aba940e809d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a6722e737b85493db74fd654f295f79d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ad4d8177-41dd-49bf-80c7-a10dc4c6b01b,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:31.795568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (23f12ac1-c28c-42e1-a2f5-8aba940e809d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.796155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Security group rule updated ['ad4d8177-41dd-49bf-80c7-a10dc4c6b01b'] Sep 27 04:20:31.798081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='ingress',ethertype='IPv6',id=a504b9ce-6939-4a10-8b47-acc40a4afbea,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a6722e737b85493db74fd654f295f79d',protocol=,remote_address_group_id=,remote_group_id=ad4d8177-41dd-49bf-80c7-a10dc4c6b01b,remote_ip_prefix=,revision_number=0,security_group_id=ad4d8177-41dd-49bf-80c7-a10dc4c6b01b,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:31.798450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a504b9ce-6939-4a10-8b47-acc40a4afbea), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.798834 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Security group rule updated ['ad4d8177-41dd-49bf-80c7-a10dc4c6b01b'] Sep 27 04:20:31.799648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='ingress',ethertype='IPv4',id=aa0b8581-3438-4730-8f69-17754ca26ff5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a6722e737b85493db74fd654f295f79d',protocol=,remote_address_group_id=,remote_group_id=ad4d8177-41dd-49bf-80c7-a10dc4c6b01b,remote_ip_prefix=,revision_number=0,security_group_id=ad4d8177-41dd-49bf-80c7-a10dc4c6b01b,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:31.800048 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (aa0b8581-3438-4730-8f69-17754ca26ff5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.800389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Security group rule updated ['ad4d8177-41dd-49bf-80c7-a10dc4c6b01b'] Sep 27 04:20:31.801053 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='egress',ethertype='IPv4',id=c5ee6a89-3c4e-41dd-9726-c255b7864b9b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a6722e737b85493db74fd654f295f79d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ad4d8177-41dd-49bf-80c7-a10dc4c6b01b,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:31.801412 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c5ee6a89-3c4e-41dd-9726-c255b7864b9b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:31.801753 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a24a195b-3c58-4ab0-bb8f-361661b7fd20 admin admin] Security group rule updated ['ad4d8177-41dd-49bf-80c7-a10dc4c6b01b'] Sep 27 04:20:31.996584 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:31Z,description='Default security group',id=1a5bdafd-8388-4915-b736-0896f9dd0c7e,is_default=True,name='default',project_id='776f7ceb79e74aa3b1416863ddd4e049',revision_number=1,rules=[SecurityGroupRule(02623d90-ac9d-47b6-bf08-a83c2f987871),SecurityGroupRule(1bc2d596-129b-4251-bca5-9913266d529d),SecurityGroupRule(875570a4-8d20-48a3-819f-a8b59f52c3b1),SecurityGroupRule(e460ebf8-23bb-4352-ac4d-b342d85049e0)],shared=False,stateful=True,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:32.003283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (1a5bdafd-8388-4915-b736-0896f9dd0c7e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.005496 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='ingress',ethertype='IPv6',id=02623d90-ac9d-47b6-bf08-a83c2f987871,normalized_cidr=None,port_range_max=,port_range_min=,project_id='776f7ceb79e74aa3b1416863ddd4e049',protocol=,remote_address_group_id=,remote_group_id=1a5bdafd-8388-4915-b736-0896f9dd0c7e,remote_ip_prefix=,revision_number=0,security_group_id=1a5bdafd-8388-4915-b736-0896f9dd0c7e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:32.008084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (02623d90-ac9d-47b6-bf08-a83c2f987871), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.009142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Security group rule updated ['1a5bdafd-8388-4915-b736-0896f9dd0c7e'] Sep 27 04:20:32.013027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='egress',ethertype='IPv4',id=1bc2d596-129b-4251-bca5-9913266d529d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='776f7ceb79e74aa3b1416863ddd4e049',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1a5bdafd-8388-4915-b736-0896f9dd0c7e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:32.017444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1bc2d596-129b-4251-bca5-9913266d529d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.018458 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Security group rule updated ['1a5bdafd-8388-4915-b736-0896f9dd0c7e'] Sep 27 04:20:32.019720 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='ingress',ethertype='IPv4',id=875570a4-8d20-48a3-819f-a8b59f52c3b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='776f7ceb79e74aa3b1416863ddd4e049',protocol=,remote_address_group_id=,remote_group_id=1a5bdafd-8388-4915-b736-0896f9dd0c7e,remote_ip_prefix=,revision_number=0,security_group_id=1a5bdafd-8388-4915-b736-0896f9dd0c7e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:32.020543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (875570a4-8d20-48a3-819f-a8b59f52c3b1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.021259 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Security group rule updated ['1a5bdafd-8388-4915-b736-0896f9dd0c7e'] Sep 27 04:20:32.022586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='egress',ethertype='IPv6',id=e460ebf8-23bb-4352-ac4d-b342d85049e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='776f7ceb79e74aa3b1416863ddd4e049',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1a5bdafd-8388-4915-b736-0896f9dd0c7e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:32.023515 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e460ebf8-23bb-4352-ac4d-b342d85049e0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.025156 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-871777ae-761b-4142-b0ba-0e8feae80ef3 admin admin] Security group rule updated ['1a5bdafd-8388-4915-b736-0896f9dd0c7e'] Sep 27 04:20:32.061161 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Resource SecurityGroup deleted: ad4d8177-41dd-49bf-80c7-a10dc4c6b01b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.062681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (ad4d8177-41dd-49bf-80c7-a10dc4c6b01b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.063459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ad4d8177-41dd-49bf-80c7-a10dc4c6b01b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:32.088298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ad4d8177-41dd-49bf-80c7-a10dc4c6b01b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:32.090489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Resource SecurityGroupRule deleted: 23f12ac1-c28c-42e1-a2f5-8aba940e809d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.091027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (23f12ac1-c28c-42e1-a2f5-8aba940e809d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.091838 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Security group rule updated ['ad4d8177-41dd-49bf-80c7-a10dc4c6b01b'] Sep 27 04:20:32.093056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Resource SecurityGroupRule deleted: a504b9ce-6939-4a10-8b47-acc40a4afbea {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.093733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a504b9ce-6939-4a10-8b47-acc40a4afbea), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.094287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Security group rule updated ['ad4d8177-41dd-49bf-80c7-a10dc4c6b01b'] Sep 27 04:20:32.095307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Resource SecurityGroupRule deleted: aa0b8581-3438-4730-8f69-17754ca26ff5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.096342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (aa0b8581-3438-4730-8f69-17754ca26ff5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.096855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Security group rule updated ['ad4d8177-41dd-49bf-80c7-a10dc4c6b01b'] Sep 27 04:20:32.097374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Resource SecurityGroupRule deleted: c5ee6a89-3c4e-41dd-9726-c255b7864b9b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.097806 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c5ee6a89-3c4e-41dd-9726-c255b7864b9b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.098141 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-357a5dea-5eb2-4b11-9516-d44bd9264d92 admin admin] Security group rule updated ['ad4d8177-41dd-49bf-80c7-a10dc4c6b01b'] Sep 27 04:20:32.127985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:31Z,description='Default security group',id=ed55ad1b-63c9-4172-94e8-1de84e83672e,is_default=True,name='default',project_id='dcfbd01e12e548719c49888950d8cb56',revision_number=1,rules=[SecurityGroupRule(99a108db-ff07-4fe1-a444-89f3ee4dcc08),SecurityGroupRule(a6cc73a4-1851-4cd1-8078-056f0be6cf49),SecurityGroupRule(f365aebf-5640-4bbc-b916-fbce41444c6a),SecurityGroupRule(f8aac4af-ade1-4bbb-a04c-cdecc5ad5c5c)],shared=False,stateful=True,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:32.129180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (ed55ad1b-63c9-4172-94e8-1de84e83672e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.131594 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='ingress',ethertype='IPv4',id=99a108db-ff07-4fe1-a444-89f3ee4dcc08,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dcfbd01e12e548719c49888950d8cb56',protocol=,remote_address_group_id=,remote_group_id=ed55ad1b-63c9-4172-94e8-1de84e83672e,remote_ip_prefix=,revision_number=0,security_group_id=ed55ad1b-63c9-4172-94e8-1de84e83672e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:32.132228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (99a108db-ff07-4fe1-a444-89f3ee4dcc08), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.135159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Security group rule updated ['ed55ad1b-63c9-4172-94e8-1de84e83672e'] Sep 27 04:20:32.138405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='egress',ethertype='IPv4',id=a6cc73a4-1851-4cd1-8078-056f0be6cf49,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dcfbd01e12e548719c49888950d8cb56',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed55ad1b-63c9-4172-94e8-1de84e83672e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:32.140605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a6cc73a4-1851-4cd1-8078-056f0be6cf49), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.142160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Security group rule updated ['ed55ad1b-63c9-4172-94e8-1de84e83672e'] Sep 27 04:20:32.143673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='ingress',ethertype='IPv6',id=f365aebf-5640-4bbc-b916-fbce41444c6a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dcfbd01e12e548719c49888950d8cb56',protocol=,remote_address_group_id=,remote_group_id=ed55ad1b-63c9-4172-94e8-1de84e83672e,remote_ip_prefix=,revision_number=0,security_group_id=ed55ad1b-63c9-4172-94e8-1de84e83672e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:32.145047 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f365aebf-5640-4bbc-b916-fbce41444c6a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.146431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Security group rule updated ['ed55ad1b-63c9-4172-94e8-1de84e83672e'] Sep 27 04:20:32.149181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:31Z,description=,direction='egress',ethertype='IPv6',id=f8aac4af-ade1-4bbb-a04c-cdecc5ad5c5c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dcfbd01e12e548719c49888950d8cb56',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed55ad1b-63c9-4172-94e8-1de84e83672e,updated_at=2022-09-27T04:20:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:32.149737 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f8aac4af-ade1-4bbb-a04c-cdecc5ad5c5c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.150993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-208dc070-5775-45a7-aaf2-86650afabb10 admin admin] Security group rule updated ['ed55ad1b-63c9-4172-94e8-1de84e83672e'] Sep 27 04:20:32.214641 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Resource SecurityGroup deleted: 1a5bdafd-8388-4915-b736-0896f9dd0c7e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.215087 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (1a5bdafd-8388-4915-b736-0896f9dd0c7e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.215646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1a5bdafd-8388-4915-b736-0896f9dd0c7e',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:32.234354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1a5bdafd-8388-4915-b736-0896f9dd0c7e',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:32.234817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Resource SecurityGroupRule deleted: 02623d90-ac9d-47b6-bf08-a83c2f987871 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.235193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (02623d90-ac9d-47b6-bf08-a83c2f987871), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.235532 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Security group rule updated ['1a5bdafd-8388-4915-b736-0896f9dd0c7e'] Sep 27 04:20:32.236089 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Resource SecurityGroupRule deleted: 1bc2d596-129b-4251-bca5-9913266d529d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.236691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1bc2d596-129b-4251-bca5-9913266d529d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.237026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Security group rule updated ['1a5bdafd-8388-4915-b736-0896f9dd0c7e'] Sep 27 04:20:32.240127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Resource SecurityGroupRule deleted: 875570a4-8d20-48a3-819f-a8b59f52c3b1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.241137 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (875570a4-8d20-48a3-819f-a8b59f52c3b1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.241733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Security group rule updated ['1a5bdafd-8388-4915-b736-0896f9dd0c7e'] Sep 27 04:20:32.242325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Resource SecurityGroupRule deleted: e460ebf8-23bb-4352-ac4d-b342d85049e0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.242875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e460ebf8-23bb-4352-ac4d-b342d85049e0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.243347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7d8979e3-ab1a-4326-a194-e7508476512d admin admin] Security group rule updated ['1a5bdafd-8388-4915-b736-0896f9dd0c7e'] Sep 27 04:20:32.381543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Resource SecurityGroup deleted: ed55ad1b-63c9-4172-94e8-1de84e83672e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.382179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (ed55ad1b-63c9-4172-94e8-1de84e83672e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.382931 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ed55ad1b-63c9-4172-94e8-1de84e83672e',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:32.400757 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ed55ad1b-63c9-4172-94e8-1de84e83672e',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:32.401211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Resource SecurityGroupRule deleted: 99a108db-ff07-4fe1-a444-89f3ee4dcc08 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.401588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (99a108db-ff07-4fe1-a444-89f3ee4dcc08), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.401973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Security group rule updated ['ed55ad1b-63c9-4172-94e8-1de84e83672e'] Sep 27 04:20:32.408335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Resource SecurityGroupRule deleted: a6cc73a4-1851-4cd1-8078-056f0be6cf49 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.408708 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a6cc73a4-1851-4cd1-8078-056f0be6cf49), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.409049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Security group rule updated ['ed55ad1b-63c9-4172-94e8-1de84e83672e'] Sep 27 04:20:32.409434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Resource SecurityGroupRule deleted: f365aebf-5640-4bbc-b916-fbce41444c6a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.409826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f365aebf-5640-4bbc-b916-fbce41444c6a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.410160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Security group rule updated ['ed55ad1b-63c9-4172-94e8-1de84e83672e'] Sep 27 04:20:32.410620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Resource SecurityGroupRule deleted: f8aac4af-ade1-4bbb-a04c-cdecc5ad5c5c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:32.410921 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f8aac4af-ade1-4bbb-a04c-cdecc5ad5c5c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:32.411247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-00a40baa-f70b-4755-8141-6a5b5db767ad admin admin] Security group rule updated ['ed55ad1b-63c9-4172-94e8-1de84e83672e'] Sep 27 04:20:33.060243 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:32Z,description='Default security group',id=e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83,is_default=True,name='default',project_id='d4d4abd3268e446fb4a1867b2ab17227',revision_number=1,rules=[SecurityGroupRule(1398b401-7a66-41b3-a121-c335b0421862),SecurityGroupRule(3cc760bb-c81f-4418-a24d-ebf151d480f3),SecurityGroupRule(71d82860-43a1-417a-b8bf-c96d4cfe0d39),SecurityGroupRule(75fd83fd-a4c4-41b5-8212-9a42b14d5a48)],shared=False,stateful=True,updated_at=2022-09-27T04:20:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:33.060912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:33.061289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:32Z,description=,direction='egress',ethertype='IPv6',id=1398b401-7a66-41b3-a121-c335b0421862,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4d4abd3268e446fb4a1867b2ab17227',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83,updated_at=2022-09-27T04:20:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:33.061728 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1398b401-7a66-41b3-a121-c335b0421862), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:33.062180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Security group rule updated ['e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83'] Sep 27 04:20:33.063109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:32Z,description=,direction='ingress',ethertype='IPv4',id=3cc760bb-c81f-4418-a24d-ebf151d480f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4d4abd3268e446fb4a1867b2ab17227',protocol=,remote_address_group_id=,remote_group_id=e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83,remote_ip_prefix=,revision_number=0,security_group_id=e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83,updated_at=2022-09-27T04:20:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:33.063469 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3cc760bb-c81f-4418-a24d-ebf151d480f3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:33.063799 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Security group rule updated ['e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83'] Sep 27 04:20:33.065182 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:32Z,description=,direction='egress',ethertype='IPv4',id=71d82860-43a1-417a-b8bf-c96d4cfe0d39,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4d4abd3268e446fb4a1867b2ab17227',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83,updated_at=2022-09-27T04:20:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:33.065546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (71d82860-43a1-417a-b8bf-c96d4cfe0d39), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:33.066980 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Security group rule updated ['e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83'] Sep 27 04:20:33.070229 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:32Z,description=,direction='ingress',ethertype='IPv6',id=75fd83fd-a4c4-41b5-8212-9a42b14d5a48,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4d4abd3268e446fb4a1867b2ab17227',protocol=,remote_address_group_id=,remote_group_id=e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83,remote_ip_prefix=,revision_number=0,security_group_id=e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83,updated_at=2022-09-27T04:20:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:33.070878 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (75fd83fd-a4c4-41b5-8212-9a42b14d5a48), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:33.072458 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5426453a-c585-41fa-8fd3-3fa2e4e875c4 admin admin] Security group rule updated ['e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83'] Sep 27 04:20:33.306810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Resource SecurityGroup deleted: e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:33.308628 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:33.309730 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:33.331071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:33.331533 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Resource SecurityGroupRule deleted: 1398b401-7a66-41b3-a121-c335b0421862 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:33.331975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1398b401-7a66-41b3-a121-c335b0421862), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:33.332322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Security group rule updated ['e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83'] Sep 27 04:20:33.332728 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Resource SecurityGroupRule deleted: 3cc760bb-c81f-4418-a24d-ebf151d480f3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:33.333090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3cc760bb-c81f-4418-a24d-ebf151d480f3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:33.333422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Security group rule updated ['e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83'] Sep 27 04:20:33.333911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Resource SecurityGroupRule deleted: 71d82860-43a1-417a-b8bf-c96d4cfe0d39 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:33.334202 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (71d82860-43a1-417a-b8bf-c96d4cfe0d39), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:33.334693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Security group rule updated ['e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83'] Sep 27 04:20:33.335077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Resource SecurityGroupRule deleted: 75fd83fd-a4c4-41b5-8212-9a42b14d5a48 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:33.335431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (75fd83fd-a4c4-41b5-8212-9a42b14d5a48), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:33.335758 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b119e1ba-9177-42fd-b5e4-c38723674c69 admin admin] Security group rule updated ['e4d11b01-dd03-4b7d-9e05-a5e4b80e1d83'] Sep 27 04:20:33.435196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:255 started Sep 27 04:20:33.439677 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22be9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=262000000,duration_sec=523,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:33.441110 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:33.441903 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:255 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 27 04:20:34.227139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:34Z,description='Default security group',id=e59ab5bf-0238-4254-bf79-ad541d6035fd,is_default=True,name='default',project_id='de1f5d9b493942d088cbc5e3925d94c3',revision_number=1,rules=[SecurityGroupRule(17572f11-e1f1-4450-8232-08da3e70ff1f),SecurityGroupRule(3dcacda9-5a9f-4734-a7dd-8cce73cdcbec),SecurityGroupRule(838aaa0c-7bf8-4864-80fd-c9832a57b040),SecurityGroupRule(b1ac341f-acfe-47c5-b3d1-49dc3584e8cc)],shared=False,stateful=True,updated_at=2022-09-27T04:20:34Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:34.228352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (e59ab5bf-0238-4254-bf79-ad541d6035fd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:34.229886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:34Z,description=,direction='ingress',ethertype='IPv4',id=17572f11-e1f1-4450-8232-08da3e70ff1f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='de1f5d9b493942d088cbc5e3925d94c3',protocol=,remote_address_group_id=,remote_group_id=e59ab5bf-0238-4254-bf79-ad541d6035fd,remote_ip_prefix=,revision_number=0,security_group_id=e59ab5bf-0238-4254-bf79-ad541d6035fd,updated_at=2022-09-27T04:20:34Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:34.230449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (17572f11-e1f1-4450-8232-08da3e70ff1f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:34.232164 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Security group rule updated ['e59ab5bf-0238-4254-bf79-ad541d6035fd'] Sep 27 04:20:34.233819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:34Z,description=,direction='egress',ethertype='IPv6',id=3dcacda9-5a9f-4734-a7dd-8cce73cdcbec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='de1f5d9b493942d088cbc5e3925d94c3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e59ab5bf-0238-4254-bf79-ad541d6035fd,updated_at=2022-09-27T04:20:34Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:34.234419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3dcacda9-5a9f-4734-a7dd-8cce73cdcbec), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:34.235322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Security group rule updated ['e59ab5bf-0238-4254-bf79-ad541d6035fd'] Sep 27 04:20:34.237271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:34Z,description=,direction='ingress',ethertype='IPv6',id=838aaa0c-7bf8-4864-80fd-c9832a57b040,normalized_cidr=None,port_range_max=,port_range_min=,project_id='de1f5d9b493942d088cbc5e3925d94c3',protocol=,remote_address_group_id=,remote_group_id=e59ab5bf-0238-4254-bf79-ad541d6035fd,remote_ip_prefix=,revision_number=0,security_group_id=e59ab5bf-0238-4254-bf79-ad541d6035fd,updated_at=2022-09-27T04:20:34Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:34.237877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (838aaa0c-7bf8-4864-80fd-c9832a57b040), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:34.238395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Security group rule updated ['e59ab5bf-0238-4254-bf79-ad541d6035fd'] Sep 27 04:20:34.239577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:34Z,description=,direction='egress',ethertype='IPv4',id=b1ac341f-acfe-47c5-b3d1-49dc3584e8cc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='de1f5d9b493942d088cbc5e3925d94c3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e59ab5bf-0238-4254-bf79-ad541d6035fd,updated_at=2022-09-27T04:20:34Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:34.240155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b1ac341f-acfe-47c5-b3d1-49dc3584e8cc), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:34.240902 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4de639dc-f7b8-47ca-94b2-81ea4b5772aa admin admin] Security group rule updated ['e59ab5bf-0238-4254-bf79-ad541d6035fd'] Sep 27 04:20:34.394523 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Resource SecurityGroup deleted: e59ab5bf-0238-4254-bf79-ad541d6035fd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:34.395226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (e59ab5bf-0238-4254-bf79-ad541d6035fd), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:34.395693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e59ab5bf-0238-4254-bf79-ad541d6035fd',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:34.452496 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e59ab5bf-0238-4254-bf79-ad541d6035fd',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:34.452971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Resource SecurityGroupRule deleted: 17572f11-e1f1-4450-8232-08da3e70ff1f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:34.453544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (17572f11-e1f1-4450-8232-08da3e70ff1f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:34.454081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Security group rule updated ['e59ab5bf-0238-4254-bf79-ad541d6035fd'] Sep 27 04:20:34.454770 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Resource SecurityGroupRule deleted: 3dcacda9-5a9f-4734-a7dd-8cce73cdcbec {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:34.455266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3dcacda9-5a9f-4734-a7dd-8cce73cdcbec), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:34.455735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Security group rule updated ['e59ab5bf-0238-4254-bf79-ad541d6035fd'] Sep 27 04:20:34.456267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Resource SecurityGroupRule deleted: 838aaa0c-7bf8-4864-80fd-c9832a57b040 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:34.456766 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (838aaa0c-7bf8-4864-80fd-c9832a57b040), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:34.457246 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Security group rule updated ['e59ab5bf-0238-4254-bf79-ad541d6035fd'] Sep 27 04:20:34.457776 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Resource SecurityGroupRule deleted: b1ac341f-acfe-47c5-b3d1-49dc3584e8cc {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:34.458336 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b1ac341f-acfe-47c5-b3d1-49dc3584e8cc), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:34.458801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-29b28004-bcc5-436b-a0d7-93ac0917dd01 admin admin] Security group rule updated ['e59ab5bf-0238-4254-bf79-ad541d6035fd'] Sep 27 04:20:34.760782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port acd21fd8-866c-4c10-9697-2fe37ef43cf1 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:34.761180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (acd21fd8-866c-4c10-9697-2fe37ef43cf1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.223167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:35Z,description='Default security group',id=125b9fe9-638f-43f8-9b2d-05d2466eaf0b,is_default=True,name='default',project_id='a7a58f1304fb4f4493d562f7e2ba707e',revision_number=1,rules=[SecurityGroupRule(00b55521-32ec-4781-9d52-a570d612b6fa),SecurityGroupRule(9605ad08-1132-49d3-a057-8fb8dec6aeef),SecurityGroupRule(98a9a4f2-7bbd-4251-8dbd-ba197a1a1bca),SecurityGroupRule(9ea65300-b355-4c9a-b388-8343d2f02a91)],shared=False,stateful=True,updated_at=2022-09-27T04:20:35Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:35.223556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (125b9fe9-638f-43f8-9b2d-05d2466eaf0b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.224175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:35Z,description=,direction='egress',ethertype='IPv6',id=00b55521-32ec-4781-9d52-a570d612b6fa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7a58f1304fb4f4493d562f7e2ba707e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=125b9fe9-638f-43f8-9b2d-05d2466eaf0b,updated_at=2022-09-27T04:20:35Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:35.224547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (00b55521-32ec-4781-9d52-a570d612b6fa), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.224885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Security group rule updated ['125b9fe9-638f-43f8-9b2d-05d2466eaf0b'] Sep 27 04:20:35.225570 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:35Z,description=,direction='egress',ethertype='IPv4',id=9605ad08-1132-49d3-a057-8fb8dec6aeef,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7a58f1304fb4f4493d562f7e2ba707e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=125b9fe9-638f-43f8-9b2d-05d2466eaf0b,updated_at=2022-09-27T04:20:35Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:35.225959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9605ad08-1132-49d3-a057-8fb8dec6aeef), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.226465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Security group rule updated ['125b9fe9-638f-43f8-9b2d-05d2466eaf0b'] Sep 27 04:20:35.227131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:35Z,description=,direction='ingress',ethertype='IPv4',id=98a9a4f2-7bbd-4251-8dbd-ba197a1a1bca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7a58f1304fb4f4493d562f7e2ba707e',protocol=,remote_address_group_id=,remote_group_id=125b9fe9-638f-43f8-9b2d-05d2466eaf0b,remote_ip_prefix=,revision_number=0,security_group_id=125b9fe9-638f-43f8-9b2d-05d2466eaf0b,updated_at=2022-09-27T04:20:35Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:35.227844 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (98a9a4f2-7bbd-4251-8dbd-ba197a1a1bca), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.228381 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Security group rule updated ['125b9fe9-638f-43f8-9b2d-05d2466eaf0b'] Sep 27 04:20:35.229906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:35Z,description=,direction='ingress',ethertype='IPv6',id=9ea65300-b355-4c9a-b388-8343d2f02a91,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a7a58f1304fb4f4493d562f7e2ba707e',protocol=,remote_address_group_id=,remote_group_id=125b9fe9-638f-43f8-9b2d-05d2466eaf0b,remote_ip_prefix=,revision_number=0,security_group_id=125b9fe9-638f-43f8-9b2d-05d2466eaf0b,updated_at=2022-09-27T04:20:35Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:35.230273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9ea65300-b355-4c9a-b388-8343d2f02a91), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.230604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-949ddacb-0b83-49fa-b4f0-96cf2ba864a4 admin admin] Security group rule updated ['125b9fe9-638f-43f8-9b2d-05d2466eaf0b'] Sep 27 04:20:35.433868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Resource SecurityGroup deleted: 125b9fe9-638f-43f8-9b2d-05d2466eaf0b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:35.434260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (125b9fe9-638f-43f8-9b2d-05d2466eaf0b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.434751 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('125b9fe9-638f-43f8-9b2d-05d2466eaf0b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:35.436601 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:256 started Sep 27 04:20:35.440212 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22beb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=264000000,duration_sec=525,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:35.441012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:35.441707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:256 - starting polling. Elapsed:0.005 Sep 27 04:20:35.443899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.446920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:256 - port information retrieved. Elapsed:0.010 Sep 27 04:20:35.447263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:256 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:20:35.450107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('125b9fe9-638f-43f8-9b2d-05d2466eaf0b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:35.450564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Resource SecurityGroupRule deleted: 00b55521-32ec-4781-9d52-a570d612b6fa {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:35.450933 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (00b55521-32ec-4781-9d52-a570d612b6fa), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.451319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Security group rule updated ['125b9fe9-638f-43f8-9b2d-05d2466eaf0b'] Sep 27 04:20:35.451915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Resource SecurityGroupRule deleted: 9605ad08-1132-49d3-a057-8fb8dec6aeef {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:35.452804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9605ad08-1132-49d3-a057-8fb8dec6aeef), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.453132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Security group rule updated ['125b9fe9-638f-43f8-9b2d-05d2466eaf0b'] Sep 27 04:20:35.453507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Resource SecurityGroupRule deleted: 98a9a4f2-7bbd-4251-8dbd-ba197a1a1bca {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:35.453886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (98a9a4f2-7bbd-4251-8dbd-ba197a1a1bca), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.454208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Security group rule updated ['125b9fe9-638f-43f8-9b2d-05d2466eaf0b'] Sep 27 04:20:35.454737 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Resource SecurityGroupRule deleted: 9ea65300-b355-4c9a-b388-8343d2f02a91 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:35.455083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9ea65300-b355-4c9a-b388-8343d2f02a91), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:35.455401 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c06559a9-ee6e-45b5-a7bd-c25162275718 admin admin] Security group rule updated ['125b9fe9-638f-43f8-9b2d-05d2466eaf0b'] Sep 27 04:20:37.070978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port ef3b9eed-fccf-490a-bc0f-2fe41f79b621 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:37.071705 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ef3b9eed-fccf-490a-bc0f-2fe41f79b621), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:37.323862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port acd21fd8-866c-4c10-9697-2fe37ef43cf1 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:37.324345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (acd21fd8-866c-4c10-9697-2fe37ef43cf1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:37.438420 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:257 started Sep 27 04:20:37.441307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=265000000,duration_sec=527,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:37.442800 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:37.443241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:257 - starting polling. Elapsed:0.005 Sep 27 04:20:37.446202 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:37.449402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:257 - port information retrieved. Elapsed:0.011 Sep 27 04:20:37.450069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:257 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:20:37.479144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:37.479635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:37.773050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:37Z,description='Default security group',id=6f036b50-3058-48da-9b43-a4a368658769,is_default=True,name='default',project_id='5d736ae2114748c3801d1ae02603fe79',revision_number=1,rules=[SecurityGroupRule(0341a155-f9e5-449e-b7f7-fb107323a622),SecurityGroupRule(580ae86a-2146-4ca2-b3f8-c01c986fb508),SecurityGroupRule(71977180-0cb0-4be1-b4a0-6920a0b561c7),SecurityGroupRule(a5f30144-c769-40d3-9bfd-2428cc995486)],shared=False,stateful=True,updated_at=2022-09-27T04:20:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:37.774905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (6f036b50-3058-48da-9b43-a4a368658769), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:37.777605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:37Z,description=,direction='ingress',ethertype='IPv4',id=0341a155-f9e5-449e-b7f7-fb107323a622,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d736ae2114748c3801d1ae02603fe79',protocol=,remote_address_group_id=,remote_group_id=6f036b50-3058-48da-9b43-a4a368658769,remote_ip_prefix=,revision_number=0,security_group_id=6f036b50-3058-48da-9b43-a4a368658769,updated_at=2022-09-27T04:20:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:37.778583 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0341a155-f9e5-449e-b7f7-fb107323a622), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:37.780273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Security group rule updated ['6f036b50-3058-48da-9b43-a4a368658769'] Sep 27 04:20:37.786876 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:37Z,description=,direction='ingress',ethertype='IPv6',id=580ae86a-2146-4ca2-b3f8-c01c986fb508,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d736ae2114748c3801d1ae02603fe79',protocol=,remote_address_group_id=,remote_group_id=6f036b50-3058-48da-9b43-a4a368658769,remote_ip_prefix=,revision_number=0,security_group_id=6f036b50-3058-48da-9b43-a4a368658769,updated_at=2022-09-27T04:20:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:37.787266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (580ae86a-2146-4ca2-b3f8-c01c986fb508), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:37.787646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Security group rule updated ['6f036b50-3058-48da-9b43-a4a368658769'] Sep 27 04:20:37.788325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:37Z,description=,direction='egress',ethertype='IPv4',id=71977180-0cb0-4be1-b4a0-6920a0b561c7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d736ae2114748c3801d1ae02603fe79',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6f036b50-3058-48da-9b43-a4a368658769,updated_at=2022-09-27T04:20:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:37.795278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (71977180-0cb0-4be1-b4a0-6920a0b561c7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:37.795635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Security group rule updated ['6f036b50-3058-48da-9b43-a4a368658769'] Sep 27 04:20:37.797122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:37Z,description=,direction='egress',ethertype='IPv6',id=a5f30144-c769-40d3-9bfd-2428cc995486,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d736ae2114748c3801d1ae02603fe79',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6f036b50-3058-48da-9b43-a4a368658769,updated_at=2022-09-27T04:20:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:37.797492 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a5f30144-c769-40d3-9bfd-2428cc995486), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:37.797858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-86af25ce-d4d4-404b-b666-bbbad67b2cd8 admin admin] Security group rule updated ['6f036b50-3058-48da-9b43-a4a368658769'] Sep 27 04:20:38.220773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Resource SecurityGroup deleted: 6f036b50-3058-48da-9b43-a4a368658769 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:38.221361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (6f036b50-3058-48da-9b43-a4a368658769), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.221940 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6f036b50-3058-48da-9b43-a4a368658769',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:38.241771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6f036b50-3058-48da-9b43-a4a368658769',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:38.242348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Resource SecurityGroupRule deleted: 0341a155-f9e5-449e-b7f7-fb107323a622 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:38.243304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0341a155-f9e5-449e-b7f7-fb107323a622), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.243709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Security group rule updated ['6f036b50-3058-48da-9b43-a4a368658769'] Sep 27 04:20:38.244181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Resource SecurityGroupRule deleted: 580ae86a-2146-4ca2-b3f8-c01c986fb508 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:38.244662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (580ae86a-2146-4ca2-b3f8-c01c986fb508), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.245200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Security group rule updated ['6f036b50-3058-48da-9b43-a4a368658769'] Sep 27 04:20:38.245804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Resource SecurityGroupRule deleted: 71977180-0cb0-4be1-b4a0-6920a0b561c7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:38.246420 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (71977180-0cb0-4be1-b4a0-6920a0b561c7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.246888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Security group rule updated ['6f036b50-3058-48da-9b43-a4a368658769'] Sep 27 04:20:38.247637 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Resource SecurityGroupRule deleted: a5f30144-c769-40d3-9bfd-2428cc995486 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:38.248133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a5f30144-c769-40d3-9bfd-2428cc995486), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.248767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ea8524c2-4fca-4f91-b56a-693a35c7af76 admin admin] Security group rule updated ['6f036b50-3058-48da-9b43-a4a368658769'] Sep 27 04:20:38.335065 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:37Z,description='Default security group',id=82ed0ade-6f20-442a-abca-a310913ba181,is_default=True,name='default',project_id='c830a3bfece6456486f4b094076b5364',revision_number=1,rules=[SecurityGroupRule(63be6f98-5844-4db6-95a5-34c220d59ac0),SecurityGroupRule(63cb1106-8aea-49bf-8349-3e80cb728c7d),SecurityGroupRule(88e104ad-a9d4-4ae8-aeb0-aff9626ed583),SecurityGroupRule(a410fbb0-476e-475d-9211-f6b4d0f3085e)],shared=False,stateful=True,updated_at=2022-09-27T04:20:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:38.335456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (82ed0ade-6f20-442a-abca-a310913ba181), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.336272 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:38Z,description=,direction='ingress',ethertype='IPv4',id=63be6f98-5844-4db6-95a5-34c220d59ac0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c830a3bfece6456486f4b094076b5364',protocol=,remote_address_group_id=,remote_group_id=82ed0ade-6f20-442a-abca-a310913ba181,remote_ip_prefix=,revision_number=0,security_group_id=82ed0ade-6f20-442a-abca-a310913ba181,updated_at=2022-09-27T04:20:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:38.336638 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (63be6f98-5844-4db6-95a5-34c220d59ac0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.337550 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Security group rule updated ['82ed0ade-6f20-442a-abca-a310913ba181'] Sep 27 04:20:38.338272 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:38Z,description=,direction='ingress',ethertype='IPv6',id=63cb1106-8aea-49bf-8349-3e80cb728c7d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c830a3bfece6456486f4b094076b5364',protocol=,remote_address_group_id=,remote_group_id=82ed0ade-6f20-442a-abca-a310913ba181,remote_ip_prefix=,revision_number=0,security_group_id=82ed0ade-6f20-442a-abca-a310913ba181,updated_at=2022-09-27T04:20:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:38.338912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (63cb1106-8aea-49bf-8349-3e80cb728c7d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.339247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Security group rule updated ['82ed0ade-6f20-442a-abca-a310913ba181'] Sep 27 04:20:38.339899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:38Z,description=,direction='egress',ethertype='IPv4',id=88e104ad-a9d4-4ae8-aeb0-aff9626ed583,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c830a3bfece6456486f4b094076b5364',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=82ed0ade-6f20-442a-abca-a310913ba181,updated_at=2022-09-27T04:20:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:38.340251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (88e104ad-a9d4-4ae8-aeb0-aff9626ed583), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.340607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Security group rule updated ['82ed0ade-6f20-442a-abca-a310913ba181'] Sep 27 04:20:38.341244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:38Z,description=,direction='egress',ethertype='IPv6',id=a410fbb0-476e-475d-9211-f6b4d0f3085e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c830a3bfece6456486f4b094076b5364',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=82ed0ade-6f20-442a-abca-a310913ba181,updated_at=2022-09-27T04:20:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:38.343970 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a410fbb0-476e-475d-9211-f6b4d0f3085e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.344471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-587c7486-42ab-40dd-b700-77c989a491ca service neutron] Security group rule updated ['82ed0ade-6f20-442a-abca-a310913ba181'] Sep 27 04:20:38.940718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:38Z,description='Default security group',id=2824daff-6365-48ef-8255-eb248aa73985,is_default=True,name='default',project_id='ea4892e5b25b4462ad734616243f81fa',revision_number=1,rules=[SecurityGroupRule(310a48b4-3c6b-49e8-b611-c7ebd7c6817c),SecurityGroupRule(7460149e-636a-46c1-b256-6411972cdfcb),SecurityGroupRule(8ece0748-18ab-40de-8a7a-727a1a4704f6),SecurityGroupRule(d4e54810-4a2b-4217-8faf-93983bea6a55)],shared=False,stateful=True,updated_at=2022-09-27T04:20:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:38.941111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (2824daff-6365-48ef-8255-eb248aa73985), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.942417 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:38Z,description=,direction='egress',ethertype='IPv4',id=310a48b4-3c6b-49e8-b611-c7ebd7c6817c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea4892e5b25b4462ad734616243f81fa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2824daff-6365-48ef-8255-eb248aa73985,updated_at=2022-09-27T04:20:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:38.942772 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (310a48b4-3c6b-49e8-b611-c7ebd7c6817c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.943115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Security group rule updated ['2824daff-6365-48ef-8255-eb248aa73985'] Sep 27 04:20:38.943789 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:38Z,description=,direction='egress',ethertype='IPv6',id=7460149e-636a-46c1-b256-6411972cdfcb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea4892e5b25b4462ad734616243f81fa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2824daff-6365-48ef-8255-eb248aa73985,updated_at=2022-09-27T04:20:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:38.944145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7460149e-636a-46c1-b256-6411972cdfcb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.944528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Security group rule updated ['2824daff-6365-48ef-8255-eb248aa73985'] Sep 27 04:20:38.945652 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:38Z,description=,direction='ingress',ethertype='IPv4',id=8ece0748-18ab-40de-8a7a-727a1a4704f6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea4892e5b25b4462ad734616243f81fa',protocol=,remote_address_group_id=,remote_group_id=2824daff-6365-48ef-8255-eb248aa73985,remote_ip_prefix=,revision_number=0,security_group_id=2824daff-6365-48ef-8255-eb248aa73985,updated_at=2022-09-27T04:20:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:38.945652 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8ece0748-18ab-40de-8a7a-727a1a4704f6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.946656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Security group rule updated ['2824daff-6365-48ef-8255-eb248aa73985'] Sep 27 04:20:38.947339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:38Z,description=,direction='ingress',ethertype='IPv6',id=d4e54810-4a2b-4217-8faf-93983bea6a55,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea4892e5b25b4462ad734616243f81fa',protocol=,remote_address_group_id=,remote_group_id=2824daff-6365-48ef-8255-eb248aa73985,remote_ip_prefix=,revision_number=0,security_group_id=2824daff-6365-48ef-8255-eb248aa73985,updated_at=2022-09-27T04:20:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:38.947692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d4e54810-4a2b-4217-8faf-93983bea6a55), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:38.948031 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2188984c-e5b1-42d0-b3ad-81f7a3a8e204 admin admin] Security group rule updated ['2824daff-6365-48ef-8255-eb248aa73985'] Sep 27 04:20:39.206691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Resource SecurityGroup deleted: 2824daff-6365-48ef-8255-eb248aa73985 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:39.207076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (2824daff-6365-48ef-8255-eb248aa73985), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.207541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2824daff-6365-48ef-8255-eb248aa73985',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:39.231236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2824daff-6365-48ef-8255-eb248aa73985',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:39.231995 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Resource SecurityGroupRule deleted: 310a48b4-3c6b-49e8-b611-c7ebd7c6817c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:39.232078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (310a48b4-3c6b-49e8-b611-c7ebd7c6817c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.232372 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Security group rule updated ['2824daff-6365-48ef-8255-eb248aa73985'] Sep 27 04:20:39.232763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Resource SecurityGroupRule deleted: 7460149e-636a-46c1-b256-6411972cdfcb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:39.233107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7460149e-636a-46c1-b256-6411972cdfcb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.234147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Security group rule updated ['2824daff-6365-48ef-8255-eb248aa73985'] Sep 27 04:20:39.234802 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Resource SecurityGroupRule deleted: 8ece0748-18ab-40de-8a7a-727a1a4704f6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:39.235320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (8ece0748-18ab-40de-8a7a-727a1a4704f6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.235780 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Security group rule updated ['2824daff-6365-48ef-8255-eb248aa73985'] Sep 27 04:20:39.236319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Resource SecurityGroupRule deleted: d4e54810-4a2b-4217-8faf-93983bea6a55 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:39.236803 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d4e54810-4a2b-4217-8faf-93983bea6a55), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.237279 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-140d9c21-5610-46bd-8604-7a19328d0d2e admin admin] Security group rule updated ['2824daff-6365-48ef-8255-eb248aa73985'] Sep 27 04:20:39.308084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:39Z,description='Default security group',id=c733e87f-eca8-47b3-8556-b3ce88d2c510,is_default=True,name='default',project_id='c5b4f63d1eb24b8eae0fe749cea44218',revision_number=1,rules=[SecurityGroupRule(24f48f06-fc7d-4449-88e6-7cdbb6717837),SecurityGroupRule(3456bb32-dfe6-4d61-9bf2-2a07b2400fae),SecurityGroupRule(5d90562c-97da-45f9-80f1-1015e0cceff4),SecurityGroupRule(c324e9c9-7ab1-4049-ac76-e73c1f8a70c1)],shared=False,stateful=True,updated_at=2022-09-27T04:20:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:39.309390 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (c733e87f-eca8-47b3-8556-b3ce88d2c510), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.311069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:39Z,description=,direction='ingress',ethertype='IPv6',id=24f48f06-fc7d-4449-88e6-7cdbb6717837,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c5b4f63d1eb24b8eae0fe749cea44218',protocol=,remote_address_group_id=,remote_group_id=c733e87f-eca8-47b3-8556-b3ce88d2c510,remote_ip_prefix=,revision_number=0,security_group_id=c733e87f-eca8-47b3-8556-b3ce88d2c510,updated_at=2022-09-27T04:20:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:39.312795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (24f48f06-fc7d-4449-88e6-7cdbb6717837), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.313465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Security group rule updated ['c733e87f-eca8-47b3-8556-b3ce88d2c510'] Sep 27 04:20:39.314389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:39Z,description=,direction='egress',ethertype='IPv4',id=3456bb32-dfe6-4d61-9bf2-2a07b2400fae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c5b4f63d1eb24b8eae0fe749cea44218',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c733e87f-eca8-47b3-8556-b3ce88d2c510,updated_at=2022-09-27T04:20:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:39.315588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3456bb32-dfe6-4d61-9bf2-2a07b2400fae), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.316433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Security group rule updated ['c733e87f-eca8-47b3-8556-b3ce88d2c510'] Sep 27 04:20:39.317310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:39Z,description=,direction='ingress',ethertype='IPv4',id=5d90562c-97da-45f9-80f1-1015e0cceff4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c5b4f63d1eb24b8eae0fe749cea44218',protocol=,remote_address_group_id=,remote_group_id=c733e87f-eca8-47b3-8556-b3ce88d2c510,remote_ip_prefix=,revision_number=0,security_group_id=c733e87f-eca8-47b3-8556-b3ce88d2c510,updated_at=2022-09-27T04:20:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:39.317885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5d90562c-97da-45f9-80f1-1015e0cceff4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.318392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Security group rule updated ['c733e87f-eca8-47b3-8556-b3ce88d2c510'] Sep 27 04:20:39.319666 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:39Z,description=,direction='egress',ethertype='IPv6',id=c324e9c9-7ab1-4049-ac76-e73c1f8a70c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c5b4f63d1eb24b8eae0fe749cea44218',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c733e87f-eca8-47b3-8556-b3ce88d2c510,updated_at=2022-09-27T04:20:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:39.320391 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c324e9c9-7ab1-4049-ac76-e73c1f8a70c1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.321198 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3b9e5aed-b7dc-4b30-be5a-9c8ac60a2675 admin admin] Security group rule updated ['c733e87f-eca8-47b3-8556-b3ce88d2c510'] Sep 27 04:20:39.440255 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:258 started Sep 27 04:20:39.443838 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Resource SecurityGroup deleted: c733e87f-eca8-47b3-8556-b3ce88d2c510 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:39.444226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (c733e87f-eca8-47b3-8556-b3ce88d2c510), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.445922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c733e87f-eca8-47b3-8556-b3ce88d2c510',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:39.451361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=275000000,duration_sec=529,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:39.452303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:39.452644 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:258 - starting polling. Elapsed:0.013 Sep 27 04:20:39.454702 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.457634 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:258 - port information retrieved. Elapsed:0.017 Sep 27 04:20:39.457938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:258 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 27 04:20:39.472725 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c733e87f-eca8-47b3-8556-b3ce88d2c510',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:39.473171 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Resource SecurityGroupRule deleted: 24f48f06-fc7d-4449-88e6-7cdbb6717837 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:39.473542 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (24f48f06-fc7d-4449-88e6-7cdbb6717837), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.474261 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Security group rule updated ['c733e87f-eca8-47b3-8556-b3ce88d2c510'] Sep 27 04:20:39.474809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Resource SecurityGroupRule deleted: 3456bb32-dfe6-4d61-9bf2-2a07b2400fae {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:39.477579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3456bb32-dfe6-4d61-9bf2-2a07b2400fae), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.482013 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Security group rule updated ['c733e87f-eca8-47b3-8556-b3ce88d2c510'] Sep 27 04:20:39.483804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Resource SecurityGroupRule deleted: 5d90562c-97da-45f9-80f1-1015e0cceff4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:39.484322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5d90562c-97da-45f9-80f1-1015e0cceff4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.484809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Security group rule updated ['c733e87f-eca8-47b3-8556-b3ce88d2c510'] Sep 27 04:20:39.485193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Resource SecurityGroupRule deleted: c324e9c9-7ab1-4049-ac76-e73c1f8a70c1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:39.485546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c324e9c9-7ab1-4049-ac76-e73c1f8a70c1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:39.485895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f15b59e7-4b13-4822-b004-9c7c5ebba400 admin admin] Security group rule updated ['c733e87f-eca8-47b3-8556-b3ce88d2c510'] Sep 27 04:20:40.055550 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:39Z,description='Default security group',id=5648e7fa-7a2d-4664-b6e6-95032e2c2065,is_default=True,name='default',project_id='3a7201c9aa744077b931b70cdbc7295b',revision_number=1,rules=[SecurityGroupRule(82cf6a50-c443-4fc0-8ae8-223765b51707),SecurityGroupRule(93f0c8b9-7de8-42fd-9fa9-f16475c452bd),SecurityGroupRule(9b740d69-5488-45e2-997a-6380785200d8),SecurityGroupRule(e73f5eb0-0282-4001-b87c-2a3441fe4724)],shared=False,stateful=True,updated_at=2022-09-27T04:20:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:40.056033 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (5648e7fa-7a2d-4664-b6e6-95032e2c2065), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:40.056737 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:39Z,description=,direction='ingress',ethertype='IPv4',id=82cf6a50-c443-4fc0-8ae8-223765b51707,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3a7201c9aa744077b931b70cdbc7295b',protocol=,remote_address_group_id=,remote_group_id=5648e7fa-7a2d-4664-b6e6-95032e2c2065,remote_ip_prefix=,revision_number=0,security_group_id=5648e7fa-7a2d-4664-b6e6-95032e2c2065,updated_at=2022-09-27T04:20:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:40.057171 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (82cf6a50-c443-4fc0-8ae8-223765b51707), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:40.057701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Security group rule updated ['5648e7fa-7a2d-4664-b6e6-95032e2c2065'] Sep 27 04:20:40.058413 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:39Z,description=,direction='egress',ethertype='IPv6',id=93f0c8b9-7de8-42fd-9fa9-f16475c452bd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3a7201c9aa744077b931b70cdbc7295b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5648e7fa-7a2d-4664-b6e6-95032e2c2065,updated_at=2022-09-27T04:20:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:40.058773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (93f0c8b9-7de8-42fd-9fa9-f16475c452bd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:40.059544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Security group rule updated ['5648e7fa-7a2d-4664-b6e6-95032e2c2065'] Sep 27 04:20:40.060227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:39Z,description=,direction='ingress',ethertype='IPv6',id=9b740d69-5488-45e2-997a-6380785200d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3a7201c9aa744077b931b70cdbc7295b',protocol=,remote_address_group_id=,remote_group_id=5648e7fa-7a2d-4664-b6e6-95032e2c2065,remote_ip_prefix=,revision_number=0,security_group_id=5648e7fa-7a2d-4664-b6e6-95032e2c2065,updated_at=2022-09-27T04:20:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:40.060644 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9b740d69-5488-45e2-997a-6380785200d8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:40.060983 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Security group rule updated ['5648e7fa-7a2d-4664-b6e6-95032e2c2065'] Sep 27 04:20:40.061971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:39Z,description=,direction='egress',ethertype='IPv4',id=e73f5eb0-0282-4001-b87c-2a3441fe4724,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3a7201c9aa744077b931b70cdbc7295b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5648e7fa-7a2d-4664-b6e6-95032e2c2065,updated_at=2022-09-27T04:20:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:40.062328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e73f5eb0-0282-4001-b87c-2a3441fe4724), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:40.062886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-64313ba1-22b8-4e23-ba94-ecbc6f12efa6 admin admin] Security group rule updated ['5648e7fa-7a2d-4664-b6e6-95032e2c2065'] Sep 27 04:20:40.218807 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Resource SecurityGroup deleted: 5648e7fa-7a2d-4664-b6e6-95032e2c2065 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:40.219190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (5648e7fa-7a2d-4664-b6e6-95032e2c2065), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:40.219650 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5648e7fa-7a2d-4664-b6e6-95032e2c2065',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:40.238341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5648e7fa-7a2d-4664-b6e6-95032e2c2065',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:40.238984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Resource SecurityGroupRule deleted: 82cf6a50-c443-4fc0-8ae8-223765b51707 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:40.242806 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (82cf6a50-c443-4fc0-8ae8-223765b51707), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:40.243158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Security group rule updated ['5648e7fa-7a2d-4664-b6e6-95032e2c2065'] Sep 27 04:20:40.243569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Resource SecurityGroupRule deleted: 93f0c8b9-7de8-42fd-9fa9-f16475c452bd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:40.244090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (93f0c8b9-7de8-42fd-9fa9-f16475c452bd), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:40.244948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Security group rule updated ['5648e7fa-7a2d-4664-b6e6-95032e2c2065'] Sep 27 04:20:40.245861 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Resource SecurityGroupRule deleted: 9b740d69-5488-45e2-997a-6380785200d8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:40.246352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9b740d69-5488-45e2-997a-6380785200d8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:40.246812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Security group rule updated ['5648e7fa-7a2d-4664-b6e6-95032e2c2065'] Sep 27 04:20:40.247339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Resource SecurityGroupRule deleted: e73f5eb0-0282-4001-b87c-2a3441fe4724 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:40.247819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e73f5eb0-0282-4001-b87c-2a3441fe4724), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:40.248273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-75374fab-32af-40b9-9277-03886f442ce5 admin admin] Security group rule updated ['5648e7fa-7a2d-4664-b6e6-95032e2c2065'] Sep 27 04:20:41.441439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:259 started Sep 27 04:20:41.444573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bf1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=268000000,duration_sec=531,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:41.446096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:41.446757 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:259 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:20:41.515152 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:41Z,description='Default security group',id=8397793a-81e7-4a0a-a47e-96ee6218b77c,is_default=True,name='default',project_id='1ffa7078248541158035d49ab4254b73',revision_number=1,rules=[SecurityGroupRule(2bfc6479-c7fe-4d6d-b3e1-5ccb0d0546f5),SecurityGroupRule(2e2e1e2d-e3f5-4395-8458-997caca95340),SecurityGroupRule(a958755a-f2ed-461c-a4a9-88517ac8324c),SecurityGroupRule(c8e01598-bac6-4d87-a131-b597a1d772f5)],shared=False,stateful=True,updated_at=2022-09-27T04:20:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:41.515766 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (8397793a-81e7-4a0a-a47e-96ee6218b77c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:41.516527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:41Z,description=,direction='egress',ethertype='IPv6',id=2bfc6479-c7fe-4d6d-b3e1-5ccb0d0546f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1ffa7078248541158035d49ab4254b73',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8397793a-81e7-4a0a-a47e-96ee6218b77c,updated_at=2022-09-27T04:20:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:41.517289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2bfc6479-c7fe-4d6d-b3e1-5ccb0d0546f5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:41.518175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Security group rule updated ['8397793a-81e7-4a0a-a47e-96ee6218b77c'] Sep 27 04:20:41.519128 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:41Z,description=,direction='ingress',ethertype='IPv6',id=2e2e1e2d-e3f5-4395-8458-997caca95340,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1ffa7078248541158035d49ab4254b73',protocol=,remote_address_group_id=,remote_group_id=8397793a-81e7-4a0a-a47e-96ee6218b77c,remote_ip_prefix=,revision_number=0,security_group_id=8397793a-81e7-4a0a-a47e-96ee6218b77c,updated_at=2022-09-27T04:20:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:41.519729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2e2e1e2d-e3f5-4395-8458-997caca95340), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:41.520266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Security group rule updated ['8397793a-81e7-4a0a-a47e-96ee6218b77c'] Sep 27 04:20:41.521125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:41Z,description=,direction='egress',ethertype='IPv4',id=a958755a-f2ed-461c-a4a9-88517ac8324c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1ffa7078248541158035d49ab4254b73',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8397793a-81e7-4a0a-a47e-96ee6218b77c,updated_at=2022-09-27T04:20:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:41.522577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a958755a-f2ed-461c-a4a9-88517ac8324c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:41.523564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Security group rule updated ['8397793a-81e7-4a0a-a47e-96ee6218b77c'] Sep 27 04:20:41.524460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:41Z,description=,direction='ingress',ethertype='IPv4',id=c8e01598-bac6-4d87-a131-b597a1d772f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1ffa7078248541158035d49ab4254b73',protocol=,remote_address_group_id=,remote_group_id=8397793a-81e7-4a0a-a47e-96ee6218b77c,remote_ip_prefix=,revision_number=0,security_group_id=8397793a-81e7-4a0a-a47e-96ee6218b77c,updated_at=2022-09-27T04:20:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:41.525923 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c8e01598-bac6-4d87-a131-b597a1d772f5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:41.526587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Security group rule updated ['8397793a-81e7-4a0a-a47e-96ee6218b77c'] Sep 27 04:20:41.755354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:41Z,description='Default security group',id=237448e0-6469-49c8-819c-6d117871c2a5,is_default=True,name='default',project_id='23cf7efa73b14cab92137fda57640001',revision_number=1,rules=[SecurityGroupRule(5e662f58-081f-4af2-b10a-a67b088b6d0c),SecurityGroupRule(85fde20f-ed04-4eb8-ac22-447d3ae591d3),SecurityGroupRule(ad1bb98f-91d3-45aa-b373-278ab71b4d4d),SecurityGroupRule(e4a87ac9-9e0d-4d64-ad8f-6a166e560717)],shared=False,stateful=True,updated_at=2022-09-27T04:20:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:41.755750 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (237448e0-6469-49c8-819c-6d117871c2a5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:41.756383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:41Z,description=,direction='ingress',ethertype='IPv4',id=5e662f58-081f-4af2-b10a-a67b088b6d0c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='23cf7efa73b14cab92137fda57640001',protocol=,remote_address_group_id=,remote_group_id=237448e0-6469-49c8-819c-6d117871c2a5,remote_ip_prefix=,revision_number=0,security_group_id=237448e0-6469-49c8-819c-6d117871c2a5,updated_at=2022-09-27T04:20:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:41.756771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5e662f58-081f-4af2-b10a-a67b088b6d0c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:41.757835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Security group rule updated ['237448e0-6469-49c8-819c-6d117871c2a5'] Sep 27 04:20:41.758609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:41Z,description=,direction='egress',ethertype='IPv6',id=85fde20f-ed04-4eb8-ac22-447d3ae591d3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='23cf7efa73b14cab92137fda57640001',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=237448e0-6469-49c8-819c-6d117871c2a5,updated_at=2022-09-27T04:20:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:41.758908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (85fde20f-ed04-4eb8-ac22-447d3ae591d3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:41.759300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Security group rule updated ['237448e0-6469-49c8-819c-6d117871c2a5'] Sep 27 04:20:41.759976 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:41Z,description=,direction='ingress',ethertype='IPv6',id=ad1bb98f-91d3-45aa-b373-278ab71b4d4d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='23cf7efa73b14cab92137fda57640001',protocol=,remote_address_group_id=,remote_group_id=237448e0-6469-49c8-819c-6d117871c2a5,remote_ip_prefix=,revision_number=0,security_group_id=237448e0-6469-49c8-819c-6d117871c2a5,updated_at=2022-09-27T04:20:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:41.761169 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ad1bb98f-91d3-45aa-b373-278ab71b4d4d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:41.761689 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Security group rule updated ['237448e0-6469-49c8-819c-6d117871c2a5'] Sep 27 04:20:41.765233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:41Z,description=,direction='egress',ethertype='IPv4',id=e4a87ac9-9e0d-4d64-ad8f-6a166e560717,normalized_cidr=None,port_range_max=,port_range_min=,project_id='23cf7efa73b14cab92137fda57640001',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=237448e0-6469-49c8-819c-6d117871c2a5,updated_at=2022-09-27T04:20:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:41.767482 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e4a87ac9-9e0d-4d64-ad8f-6a166e560717), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:41.768015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1dfdffb7-d47f-4564-a318-1205d303bf65 admin admin] Security group rule updated ['237448e0-6469-49c8-819c-6d117871c2a5'] Sep 27 04:20:42.007056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:20:41Z,description='',dns_domain=None,id=1afc1755-434f-4422-8cf4-6b447aed4322,mtu=1500,name='tempest-VolumesActionsTest-378124765-network',project_id='1ffa7078248541158035d49ab4254b73',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(1afc1755-434f-4422-8cf4-6b447aed4322),segments=[NetworkSegment(279e0395-fb1e-4db2-a16e-8a7c7b8b5d5b)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:20:41Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:42.007443 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (1afc1755-434f-4422-8cf4-6b447aed4322), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.025811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Resource SecurityGroup deleted: 237448e0-6469-49c8-819c-6d117871c2a5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:42.026766 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (237448e0-6469-49c8-819c-6d117871c2a5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.030301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('237448e0-6469-49c8-819c-6d117871c2a5',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:42.076725 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port ef3b9eed-fccf-490a-bc0f-2fe41f79b621 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:42.077262 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ef3b9eed-fccf-490a-bc0f-2fe41f79b621), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.163598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('237448e0-6469-49c8-819c-6d117871c2a5',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:42.165417 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Resource SecurityGroupRule deleted: 5e662f58-081f-4af2-b10a-a67b088b6d0c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:42.166407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5e662f58-081f-4af2-b10a-a67b088b6d0c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.167276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Security group rule updated ['237448e0-6469-49c8-819c-6d117871c2a5'] Sep 27 04:20:42.168502 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Resource SecurityGroupRule deleted: 85fde20f-ed04-4eb8-ac22-447d3ae591d3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:42.169212 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (85fde20f-ed04-4eb8-ac22-447d3ae591d3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.170043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Security group rule updated ['237448e0-6469-49c8-819c-6d117871c2a5'] Sep 27 04:20:42.171319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Resource SecurityGroupRule deleted: ad1bb98f-91d3-45aa-b373-278ab71b4d4d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:42.172787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ad1bb98f-91d3-45aa-b373-278ab71b4d4d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.173677 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Security group rule updated ['237448e0-6469-49c8-819c-6d117871c2a5'] Sep 27 04:20:42.174796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Resource SecurityGroupRule deleted: e4a87ac9-9e0d-4d64-ad8f-6a166e560717 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:42.175554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e4a87ac9-9e0d-4d64-ad8f-6a166e560717), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.176111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c71c2811-bf2b-466d-926c-ecf7e6c07885 admin admin] Security group rule updated ['237448e0-6469-49c8-819c-6d117871c2a5'] Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-902eb6ac-9649-4486-878a-5b379e82cdd2 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1afc1755-434f-4422-8cf4-6b447aed4322 with segmentation id not found. Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:20:42.299814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:20:42.300822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:20:42.300822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:20:42.300822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:20:42.300822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1afc1755-434f-4422-8cf4-6b447aed4322 with segmentation id not found. Sep 27 04:20:42.300822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:20:42.596976 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:20:42.597608 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.666218 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-56ba756f-403a-4ba4-b374-a3526f9ef7a4 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(4acd86c7-c050-4a4c-b742-e64ac2eb44de)],cidr=172.20.0.0/28,created_at=2022-09-27T04:20:42Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=506c094e-adb2-476c-8a72-6b2e0b04ffd8,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-378124765-subnet',network_id=1afc1755-434f-4422-8cf4-6b447aed4322,project_id='1ffa7078248541158035d49ab4254b73',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:42.666608 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-56ba756f-403a-4ba4-b374-a3526f9ef7a4 admin admin] Publish callbacks [] for Subnet (506c094e-adb2-476c-8a72-6b2e0b04ffd8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.678153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:42Z,description='Default security group',id=67b59fce-d936-41ff-8893-1aba6c0886e2,is_default=True,name='default',project_id='1ff813b3184047249b2ad5ab9d6743f7',revision_number=1,rules=[SecurityGroupRule(098dc35d-c777-4e7e-b643-e69a6cce6a4c),SecurityGroupRule(18e8a71f-b0bd-4703-a050-9a3c95604ce8),SecurityGroupRule(5cbc446c-9cea-454e-986f-cc2610a650c8),SecurityGroupRule(c4a75b45-88c7-4abd-a028-274b11cb017c)],shared=False,stateful=True,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:42.679851 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (67b59fce-d936-41ff-8893-1aba6c0886e2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.682768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:42Z,description=,direction='egress',ethertype='IPv4',id=098dc35d-c777-4e7e-b643-e69a6cce6a4c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1ff813b3184047249b2ad5ab9d6743f7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=67b59fce-d936-41ff-8893-1aba6c0886e2,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:42.683291 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (098dc35d-c777-4e7e-b643-e69a6cce6a4c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.684233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Security group rule updated ['67b59fce-d936-41ff-8893-1aba6c0886e2'] Sep 27 04:20:42.686466 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:42Z,description=,direction='ingress',ethertype='IPv4',id=18e8a71f-b0bd-4703-a050-9a3c95604ce8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1ff813b3184047249b2ad5ab9d6743f7',protocol=,remote_address_group_id=,remote_group_id=67b59fce-d936-41ff-8893-1aba6c0886e2,remote_ip_prefix=,revision_number=0,security_group_id=67b59fce-d936-41ff-8893-1aba6c0886e2,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:42.686842 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (18e8a71f-b0bd-4703-a050-9a3c95604ce8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.687186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Security group rule updated ['67b59fce-d936-41ff-8893-1aba6c0886e2'] Sep 27 04:20:42.690362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:42Z,description=,direction='egress',ethertype='IPv6',id=5cbc446c-9cea-454e-986f-cc2610a650c8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1ff813b3184047249b2ad5ab9d6743f7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=67b59fce-d936-41ff-8893-1aba6c0886e2,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:42.691079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5cbc446c-9cea-454e-986f-cc2610a650c8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.691437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Security group rule updated ['67b59fce-d936-41ff-8893-1aba6c0886e2'] Sep 27 04:20:42.692138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:42Z,description=,direction='ingress',ethertype='IPv6',id=c4a75b45-88c7-4abd-a028-274b11cb017c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1ff813b3184047249b2ad5ab9d6743f7',protocol=,remote_address_group_id=,remote_group_id=67b59fce-d936-41ff-8893-1aba6c0886e2,remote_ip_prefix=,revision_number=0,security_group_id=67b59fce-d936-41ff-8893-1aba6c0886e2,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:42.692501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c4a75b45-88c7-4abd-a028-274b11cb017c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.692838 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ff444f1b-2727-4cd5-93be-366657599d46 admin admin] Security group rule updated ['67b59fce-d936-41ff-8893-1aba6c0886e2'] Sep 27 04:20:42.935503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Resource SecurityGroup deleted: 67b59fce-d936-41ff-8893-1aba6c0886e2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:42.935948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (67b59fce-d936-41ff-8893-1aba6c0886e2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:42.936433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('67b59fce-d936-41ff-8893-1aba6c0886e2',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:43.067976 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:42Z,description='Default security group',id=5c626185-224e-4606-8830-05c465947c32,is_default=True,name='default',project_id='a25926354d504c84a348bbe506b83b3a',revision_number=1,rules=[SecurityGroupRule(3e422f28-13e5-41f2-8575-41b5a9998a3b),SecurityGroupRule(7f2afa5b-dc0d-421b-a12b-bd56f537caf5),SecurityGroupRule(f3115e2e-0fd6-4752-bbcc-db7affe184c6),SecurityGroupRule(f9121265-3ea3-48d9-bc13-58d75d713eba)],shared=False,stateful=True,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:43.068584 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (5c626185-224e-4606-8830-05c465947c32), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.069290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:42Z,description=,direction='egress',ethertype='IPv4',id=3e422f28-13e5-41f2-8575-41b5a9998a3b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a25926354d504c84a348bbe506b83b3a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5c626185-224e-4606-8830-05c465947c32,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:43.069905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3e422f28-13e5-41f2-8575-41b5a9998a3b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.070500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Security group rule updated ['5c626185-224e-4606-8830-05c465947c32'] Sep 27 04:20:43.071348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:42Z,description=,direction='egress',ethertype='IPv6',id=7f2afa5b-dc0d-421b-a12b-bd56f537caf5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a25926354d504c84a348bbe506b83b3a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5c626185-224e-4606-8830-05c465947c32,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:43.071873 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7f2afa5b-dc0d-421b-a12b-bd56f537caf5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.072363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Security group rule updated ['5c626185-224e-4606-8830-05c465947c32'] Sep 27 04:20:43.073447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:42Z,description=,direction='ingress',ethertype='IPv4',id=f3115e2e-0fd6-4752-bbcc-db7affe184c6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a25926354d504c84a348bbe506b83b3a',protocol=,remote_address_group_id=,remote_group_id=5c626185-224e-4606-8830-05c465947c32,remote_ip_prefix=,revision_number=0,security_group_id=5c626185-224e-4606-8830-05c465947c32,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:43.074118 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f3115e2e-0fd6-4752-bbcc-db7affe184c6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.074630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Security group rule updated ['5c626185-224e-4606-8830-05c465947c32'] Sep 27 04:20:43.075634 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:42Z,description=,direction='ingress',ethertype='IPv6',id=f9121265-3ea3-48d9-bc13-58d75d713eba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a25926354d504c84a348bbe506b83b3a',protocol=,remote_address_group_id=,remote_group_id=5c626185-224e-4606-8830-05c465947c32,remote_ip_prefix=,revision_number=0,security_group_id=5c626185-224e-4606-8830-05c465947c32,updated_at=2022-09-27T04:20:42Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:43.079154 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f9121265-3ea3-48d9-bc13-58d75d713eba), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.079704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f80a0949-0f80-4e59-8684-edc0cfc55296 admin admin] Security group rule updated ['5c626185-224e-4606-8830-05c465947c32'] Sep 27 04:20:43.122317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('67b59fce-d936-41ff-8893-1aba6c0886e2',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:43.123439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Resource SecurityGroupRule deleted: 098dc35d-c777-4e7e-b643-e69a6cce6a4c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:43.124620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (098dc35d-c777-4e7e-b643-e69a6cce6a4c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.125239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Security group rule updated ['67b59fce-d936-41ff-8893-1aba6c0886e2'] Sep 27 04:20:43.125827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Resource SecurityGroupRule deleted: 18e8a71f-b0bd-4703-a050-9a3c95604ce8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:43.126810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (18e8a71f-b0bd-4703-a050-9a3c95604ce8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.127293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Security group rule updated ['67b59fce-d936-41ff-8893-1aba6c0886e2'] Sep 27 04:20:43.127816 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Resource SecurityGroupRule deleted: 5cbc446c-9cea-454e-986f-cc2610a650c8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:43.128839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5cbc446c-9cea-454e-986f-cc2610a650c8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.129912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Security group rule updated ['67b59fce-d936-41ff-8893-1aba6c0886e2'] Sep 27 04:20:43.130500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Resource SecurityGroupRule deleted: c4a75b45-88c7-4abd-a028-274b11cb017c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:43.131919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c4a75b45-88c7-4abd-a028-274b11cb017c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.132672 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-30272a4c-c22f-4b19-8190-0799801889e1 admin admin] Security group rule updated ['67b59fce-d936-41ff-8893-1aba6c0886e2'] Sep 27 04:20:43.236406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Resource SecurityGroup deleted: 5c626185-224e-4606-8830-05c465947c32 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:43.237630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (5c626185-224e-4606-8830-05c465947c32), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.239524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5c626185-224e-4606-8830-05c465947c32',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:43.427317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5c626185-224e-4606-8830-05c465947c32',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:43.429277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Resource SecurityGroupRule deleted: 3e422f28-13e5-41f2-8575-41b5a9998a3b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:43.430413 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3e422f28-13e5-41f2-8575-41b5a9998a3b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.430968 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Security group rule updated ['5c626185-224e-4606-8830-05c465947c32'] Sep 27 04:20:43.431575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Resource SecurityGroupRule deleted: 7f2afa5b-dc0d-421b-a12b-bd56f537caf5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:43.432343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7f2afa5b-dc0d-421b-a12b-bd56f537caf5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.433575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Security group rule updated ['5c626185-224e-4606-8830-05c465947c32'] Sep 27 04:20:43.434501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Resource SecurityGroupRule deleted: f3115e2e-0fd6-4752-bbcc-db7affe184c6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:43.437045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f3115e2e-0fd6-4752-bbcc-db7affe184c6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.437573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Security group rule updated ['5c626185-224e-4606-8830-05c465947c32'] Sep 27 04:20:43.438193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Resource SecurityGroupRule deleted: f9121265-3ea3-48d9-bc13-58d75d713eba {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:43.438695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f9121265-3ea3-48d9-bc13-58d75d713eba), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.439318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ea6ba483-6f39-41e8-a4a0-056dc0ef121d admin admin] Security group rule updated ['5c626185-224e-4606-8830-05c465947c32'] Sep 27 04:20:43.442377 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:260 started Sep 27 04:20:43.447104 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bf3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=270000000,duration_sec=533,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:43.447880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:43.448711 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:260 - starting polling. Elapsed:0.006 Sep 27 04:20:43.453068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:43.456795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:260 - port information retrieved. Elapsed:0.014 Sep 27 04:20:43.457300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:260 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 27 04:20:44.044156 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:43Z,description='Default security group',id=773df142-b570-4e03-97d6-9e00a6f61ac5,is_default=True,name='default',project_id='0ec09a0648bd421981a633352221b9dd',revision_number=1,rules=[SecurityGroupRule(327046a3-0234-4485-be4d-1dc2da24cf05),SecurityGroupRule(92140519-4bda-45ee-ba86-8bb9f2e3fa0a),SecurityGroupRule(cbf417ba-0c26-4307-9e15-37a9ade19b89),SecurityGroupRule(dd4006c7-9c47-409c-9ebf-dfee32271515)],shared=False,stateful=True,updated_at=2022-09-27T04:20:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.045701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (773df142-b570-4e03-97d6-9e00a6f61ac5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.046700 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:43Z,description=,direction='ingress',ethertype='IPv4',id=327046a3-0234-4485-be4d-1dc2da24cf05,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ec09a0648bd421981a633352221b9dd',protocol=,remote_address_group_id=,remote_group_id=773df142-b570-4e03-97d6-9e00a6f61ac5,remote_ip_prefix=,revision_number=0,security_group_id=773df142-b570-4e03-97d6-9e00a6f61ac5,updated_at=2022-09-27T04:20:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.047564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (327046a3-0234-4485-be4d-1dc2da24cf05), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.048006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Security group rule updated ['773df142-b570-4e03-97d6-9e00a6f61ac5'] Sep 27 04:20:44.049109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:43Z,description=,direction='egress',ethertype='IPv4',id=92140519-4bda-45ee-ba86-8bb9f2e3fa0a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ec09a0648bd421981a633352221b9dd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=773df142-b570-4e03-97d6-9e00a6f61ac5,updated_at=2022-09-27T04:20:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.049543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (92140519-4bda-45ee-ba86-8bb9f2e3fa0a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.050123 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Security group rule updated ['773df142-b570-4e03-97d6-9e00a6f61ac5'] Sep 27 04:20:44.051310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:43Z,description=,direction='egress',ethertype='IPv6',id=cbf417ba-0c26-4307-9e15-37a9ade19b89,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ec09a0648bd421981a633352221b9dd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=773df142-b570-4e03-97d6-9e00a6f61ac5,updated_at=2022-09-27T04:20:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.051953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cbf417ba-0c26-4307-9e15-37a9ade19b89), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.052357 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Security group rule updated ['773df142-b570-4e03-97d6-9e00a6f61ac5'] Sep 27 04:20:44.053138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:43Z,description=,direction='ingress',ethertype='IPv6',id=dd4006c7-9c47-409c-9ebf-dfee32271515,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ec09a0648bd421981a633352221b9dd',protocol=,remote_address_group_id=,remote_group_id=773df142-b570-4e03-97d6-9e00a6f61ac5,remote_ip_prefix=,revision_number=0,security_group_id=773df142-b570-4e03-97d6-9e00a6f61ac5,updated_at=2022-09-27T04:20:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.053583 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (dd4006c7-9c47-409c-9ebf-dfee32271515), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.053987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0a30e666-ce3f-4ca2-9d7e-dff4f5e4ad32 admin admin] Security group rule updated ['773df142-b570-4e03-97d6-9e00a6f61ac5'] Sep 27 04:20:44.430662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Resource SecurityGroup deleted: 773df142-b570-4e03-97d6-9e00a6f61ac5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:44.431382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (773df142-b570-4e03-97d6-9e00a6f61ac5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.432108 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('773df142-b570-4e03-97d6-9e00a6f61ac5',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:44.449590 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('773df142-b570-4e03-97d6-9e00a6f61ac5',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:44.450511 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Resource SecurityGroupRule deleted: 327046a3-0234-4485-be4d-1dc2da24cf05 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:44.451184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (327046a3-0234-4485-be4d-1dc2da24cf05), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.451764 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Security group rule updated ['773df142-b570-4e03-97d6-9e00a6f61ac5'] Sep 27 04:20:44.452390 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Resource SecurityGroupRule deleted: 92140519-4bda-45ee-ba86-8bb9f2e3fa0a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:44.453019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (92140519-4bda-45ee-ba86-8bb9f2e3fa0a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.453593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Security group rule updated ['773df142-b570-4e03-97d6-9e00a6f61ac5'] Sep 27 04:20:44.454289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Resource SecurityGroupRule deleted: cbf417ba-0c26-4307-9e15-37a9ade19b89 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:44.454836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cbf417ba-0c26-4307-9e15-37a9ade19b89), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.455452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Security group rule updated ['773df142-b570-4e03-97d6-9e00a6f61ac5'] Sep 27 04:20:44.456037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Resource SecurityGroupRule deleted: dd4006c7-9c47-409c-9ebf-dfee32271515 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:44.456653 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (dd4006c7-9c47-409c-9ebf-dfee32271515), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.458045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4b86fbc3-f5b4-4712-b2dd-46217d461541 admin admin] Security group rule updated ['773df142-b570-4e03-97d6-9e00a6f61ac5'] Sep 27 04:20:44.609034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:44Z,description='Default security group',id=a7debd45-d1f0-4f73-8634-2d2954673c0a,is_default=True,name='default',project_id='a5d68445c296413a86184878a98b563b',revision_number=1,rules=[SecurityGroupRule(2d365674-17e3-4371-b201-c5c1f6a8a5cb),SecurityGroupRule(36f83fec-c688-4cce-8851-4bb502c5f963),SecurityGroupRule(63f4b3c2-56e0-4283-a62a-448b78dc2e94),SecurityGroupRule(a5c34e7f-381f-43d1-afd9-447e8860fdc6)],shared=False,stateful=True,updated_at=2022-09-27T04:20:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.610340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (a7debd45-d1f0-4f73-8634-2d2954673c0a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.611183 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:44Z,description=,direction='ingress',ethertype='IPv4',id=2d365674-17e3-4371-b201-c5c1f6a8a5cb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5d68445c296413a86184878a98b563b',protocol=,remote_address_group_id=,remote_group_id=a7debd45-d1f0-4f73-8634-2d2954673c0a,remote_ip_prefix=,revision_number=0,security_group_id=a7debd45-d1f0-4f73-8634-2d2954673c0a,updated_at=2022-09-27T04:20:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.611755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2d365674-17e3-4371-b201-c5c1f6a8a5cb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.612487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Security group rule updated ['a7debd45-d1f0-4f73-8634-2d2954673c0a'] Sep 27 04:20:44.613637 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:44Z,description=,direction='egress',ethertype='IPv4',id=36f83fec-c688-4cce-8851-4bb502c5f963,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5d68445c296413a86184878a98b563b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a7debd45-d1f0-4f73-8634-2d2954673c0a,updated_at=2022-09-27T04:20:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.614334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (36f83fec-c688-4cce-8851-4bb502c5f963), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.615035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Security group rule updated ['a7debd45-d1f0-4f73-8634-2d2954673c0a'] Sep 27 04:20:44.615935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:44Z,description=,direction='egress',ethertype='IPv6',id=63f4b3c2-56e0-4283-a62a-448b78dc2e94,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5d68445c296413a86184878a98b563b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a7debd45-d1f0-4f73-8634-2d2954673c0a,updated_at=2022-09-27T04:20:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.616501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (63f4b3c2-56e0-4283-a62a-448b78dc2e94), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.616885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Security group rule updated ['a7debd45-d1f0-4f73-8634-2d2954673c0a'] Sep 27 04:20:44.617732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:44Z,description=,direction='ingress',ethertype='IPv6',id=a5c34e7f-381f-43d1-afd9-447e8860fdc6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5d68445c296413a86184878a98b563b',protocol=,remote_address_group_id=,remote_group_id=a7debd45-d1f0-4f73-8634-2d2954673c0a,remote_ip_prefix=,revision_number=0,security_group_id=a7debd45-d1f0-4f73-8634-2d2954673c0a,updated_at=2022-09-27T04:20:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.618363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a5c34e7f-381f-43d1-afd9-447e8860fdc6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:44.618965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Security group rule updated ['a7debd45-d1f0-4f73-8634-2d2954673c0a'] Sep 27 04:20:44.990710 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:20:44Z,description='',dns_domain=None,id=2cfbbe7d-ad34-4af4-8505-f9b7056fc24b,mtu=1500,name='tempest-VolumesActionsTest-527980766-network',project_id='a5d68445c296413a86184878a98b563b',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(2cfbbe7d-ad34-4af4-8505-f9b7056fc24b),segments=[NetworkSegment(360107e6-d464-438a-a264-5c0da0c68960)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:20:44Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:44.991278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (2cfbbe7d-ad34-4af4-8505-f9b7056fc24b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-2c7c18c7-405b-49ca-9919-413f4fada9ec admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2cfbbe7d-ad34-4af4-8505-f9b7056fc24b with segmentation id not found. Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:20:45.200460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:20:45.201846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:20:45.201846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:20:45.201846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:20:45.201846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2cfbbe7d-ad34-4af4-8505-f9b7056fc24b with segmentation id not found. Sep 27 04:20:45.201846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:20:45.238815 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:44Z,description='Default security group',id=c0f474e7-6899-413e-8dd6-efb5b9a162ef,is_default=True,name='default',project_id='cfe73812e575488ab8984bce1a0246ad',revision_number=1,rules=[SecurityGroupRule(11627b04-b92e-429f-9d57-970eb909ce7d),SecurityGroupRule(4ee89f79-1e22-4939-b7c7-70377c70c7e8),SecurityGroupRule(63717035-45b1-4b7e-a191-a03bd5f46c3e),SecurityGroupRule(d3def284-9ce9-4766-89d8-1335c3be1b68)],shared=False,stateful=True,updated_at=2022-09-27T04:20:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:45.239428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (c0f474e7-6899-413e-8dd6-efb5b9a162ef), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.240200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:45Z,description=,direction='egress',ethertype='IPv4',id=11627b04-b92e-429f-9d57-970eb909ce7d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cfe73812e575488ab8984bce1a0246ad',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c0f474e7-6899-413e-8dd6-efb5b9a162ef,updated_at=2022-09-27T04:20:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:45.240733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (11627b04-b92e-429f-9d57-970eb909ce7d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.241205 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Security group rule updated ['c0f474e7-6899-413e-8dd6-efb5b9a162ef'] Sep 27 04:20:45.242079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:45Z,description=,direction='ingress',ethertype='IPv4',id=4ee89f79-1e22-4939-b7c7-70377c70c7e8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cfe73812e575488ab8984bce1a0246ad',protocol=,remote_address_group_id=,remote_group_id=c0f474e7-6899-413e-8dd6-efb5b9a162ef,remote_ip_prefix=,revision_number=0,security_group_id=c0f474e7-6899-413e-8dd6-efb5b9a162ef,updated_at=2022-09-27T04:20:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:45.242582 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4ee89f79-1e22-4939-b7c7-70377c70c7e8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.243039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Security group rule updated ['c0f474e7-6899-413e-8dd6-efb5b9a162ef'] Sep 27 04:20:45.245091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:45Z,description=,direction='ingress',ethertype='IPv6',id=63717035-45b1-4b7e-a191-a03bd5f46c3e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cfe73812e575488ab8984bce1a0246ad',protocol=,remote_address_group_id=,remote_group_id=c0f474e7-6899-413e-8dd6-efb5b9a162ef,remote_ip_prefix=,revision_number=0,security_group_id=c0f474e7-6899-413e-8dd6-efb5b9a162ef,updated_at=2022-09-27T04:20:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:45.245604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (63717035-45b1-4b7e-a191-a03bd5f46c3e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.247408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Security group rule updated ['c0f474e7-6899-413e-8dd6-efb5b9a162ef'] Sep 27 04:20:45.248094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:45Z,description=,direction='egress',ethertype='IPv6',id=d3def284-9ce9-4766-89d8-1335c3be1b68,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cfe73812e575488ab8984bce1a0246ad',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c0f474e7-6899-413e-8dd6-efb5b9a162ef,updated_at=2022-09-27T04:20:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:45.248456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d3def284-9ce9-4766-89d8-1335c3be1b68), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.248786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8bc6c3ed-0f45-4f69-a045-b5ac2dfc8860 admin admin] Security group rule updated ['c0f474e7-6899-413e-8dd6-efb5b9a162ef'] Sep 27 04:20:45.402348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Resource SecurityGroup deleted: c0f474e7-6899-413e-8dd6-efb5b9a162ef {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:45.404078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (c0f474e7-6899-413e-8dd6-efb5b9a162ef), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.404872 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c0f474e7-6899-413e-8dd6-efb5b9a162ef',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:45.420371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c0f474e7-6899-413e-8dd6-efb5b9a162ef',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:45.420696 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Resource SecurityGroupRule deleted: 11627b04-b92e-429f-9d57-970eb909ce7d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:45.421389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (11627b04-b92e-429f-9d57-970eb909ce7d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.421950 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Security group rule updated ['c0f474e7-6899-413e-8dd6-efb5b9a162ef'] Sep 27 04:20:45.422513 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Resource SecurityGroupRule deleted: 4ee89f79-1e22-4939-b7c7-70377c70c7e8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:45.423253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4ee89f79-1e22-4939-b7c7-70377c70c7e8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.423751 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Security group rule updated ['c0f474e7-6899-413e-8dd6-efb5b9a162ef'] Sep 27 04:20:45.424424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Resource SecurityGroupRule deleted: 63717035-45b1-4b7e-a191-a03bd5f46c3e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:45.424913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (63717035-45b1-4b7e-a191-a03bd5f46c3e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.425417 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Security group rule updated ['c0f474e7-6899-413e-8dd6-efb5b9a162ef'] Sep 27 04:20:45.425954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Resource SecurityGroupRule deleted: d3def284-9ce9-4766-89d8-1335c3be1b68 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:45.426490 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d3def284-9ce9-4766-89d8-1335c3be1b68), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:45.426950 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-be9757a0-c4e8-4e37-84ef-495dd0c5ccbd admin admin] Security group rule updated ['c0f474e7-6899-413e-8dd6-efb5b9a162ef'] Sep 27 04:20:45.444275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:261 started Sep 27 04:20:45.449792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bf5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=274000000,duration_sec=535,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:45.450644 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:45.451721 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:261 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:20:45.483753 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cba8cc77-d291-413c-8437-449588462c5b admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(635750dd-3bee-41f2-8496-837c8b90ba86)],cidr=172.20.0.0/28,created_at=2022-09-27T04:20:45Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=bac9f75d-135d-42ac-9cad-3529337be15c,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-527980766-subnet',network_id=2cfbbe7d-ad34-4af4-8505-f9b7056fc24b,project_id='a5d68445c296413a86184878a98b563b',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:20:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:45.484352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cba8cc77-d291-413c-8437-449588462c5b admin admin] Publish callbacks [] for Subnet (bac9f75d-135d-42ac-9cad-3529337be15c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.315461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:46Z,description='Default security group',id=6cb63381-b96c-47f3-8cd0-df089223b964,is_default=True,name='default',project_id='37249b979d864db6a2af88e936781380',revision_number=1,rules=[SecurityGroupRule(355b325c-a768-4dda-9933-8bdb66ea065a),SecurityGroupRule(6180a212-ceef-4953-916d-3d98f8515da2),SecurityGroupRule(ea0b05af-a7e7-432b-b773-8fff9aade179),SecurityGroupRule(ec8c69e2-a60e-4c86-80af-1655359f3bd3)],shared=False,stateful=True,updated_at=2022-09-27T04:20:46Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:46.316162 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (6cb63381-b96c-47f3-8cd0-df089223b964), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.316450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:46Z,description=,direction='ingress',ethertype='IPv4',id=355b325c-a768-4dda-9933-8bdb66ea065a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='37249b979d864db6a2af88e936781380',protocol=,remote_address_group_id=,remote_group_id=6cb63381-b96c-47f3-8cd0-df089223b964,remote_ip_prefix=,revision_number=0,security_group_id=6cb63381-b96c-47f3-8cd0-df089223b964,updated_at=2022-09-27T04:20:46Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:46.317033 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (355b325c-a768-4dda-9933-8bdb66ea065a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.317684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Security group rule updated ['6cb63381-b96c-47f3-8cd0-df089223b964'] Sep 27 04:20:46.318722 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:46Z,description=,direction='ingress',ethertype='IPv6',id=6180a212-ceef-4953-916d-3d98f8515da2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='37249b979d864db6a2af88e936781380',protocol=,remote_address_group_id=,remote_group_id=6cb63381-b96c-47f3-8cd0-df089223b964,remote_ip_prefix=,revision_number=0,security_group_id=6cb63381-b96c-47f3-8cd0-df089223b964,updated_at=2022-09-27T04:20:46Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:46.319263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6180a212-ceef-4953-916d-3d98f8515da2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.319774 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Security group rule updated ['6cb63381-b96c-47f3-8cd0-df089223b964'] Sep 27 04:20:46.320445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:46Z,description=,direction='egress',ethertype='IPv4',id=ea0b05af-a7e7-432b-b773-8fff9aade179,normalized_cidr=None,port_range_max=,port_range_min=,project_id='37249b979d864db6a2af88e936781380',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6cb63381-b96c-47f3-8cd0-df089223b964,updated_at=2022-09-27T04:20:46Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:46.320787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ea0b05af-a7e7-432b-b773-8fff9aade179), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.321117 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Security group rule updated ['6cb63381-b96c-47f3-8cd0-df089223b964'] Sep 27 04:20:46.321778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:46Z,description=,direction='egress',ethertype='IPv6',id=ec8c69e2-a60e-4c86-80af-1655359f3bd3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='37249b979d864db6a2af88e936781380',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6cb63381-b96c-47f3-8cd0-df089223b964,updated_at=2022-09-27T04:20:46Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:46.322133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ec8c69e2-a60e-4c86-80af-1655359f3bd3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.322459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7dd02550-55bf-4f05-84dd-b949ba67f3c8 admin admin] Security group rule updated ['6cb63381-b96c-47f3-8cd0-df089223b964'] Sep 27 04:20:46.595547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:46Z,description='Default security group',id=74a18fbc-0552-4596-8382-c377f021c6fa,is_default=True,name='default',project_id='17c0e187271d4aab948bd1d9395d35d3',revision_number=1,rules=[SecurityGroupRule(3b52ece1-a4fb-44fc-8900-5594e2f002ec),SecurityGroupRule(76c57ece-25ab-4d7a-8177-f2c8ad8fed2c),SecurityGroupRule(b685378e-f78f-4eae-8fa3-f61b2fc004ec),SecurityGroupRule(d3fc0ffc-6b72-4d9f-aac1-467c7666ad0a)],shared=False,stateful=True,updated_at=2022-09-27T04:20:46Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:46.596133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (74a18fbc-0552-4596-8382-c377f021c6fa), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.596962 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:46Z,description=,direction='ingress',ethertype='IPv4',id=3b52ece1-a4fb-44fc-8900-5594e2f002ec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='17c0e187271d4aab948bd1d9395d35d3',protocol=,remote_address_group_id=,remote_group_id=74a18fbc-0552-4596-8382-c377f021c6fa,remote_ip_prefix=,revision_number=0,security_group_id=74a18fbc-0552-4596-8382-c377f021c6fa,updated_at=2022-09-27T04:20:46Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:46.597568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3b52ece1-a4fb-44fc-8900-5594e2f002ec), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.598328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Security group rule updated ['74a18fbc-0552-4596-8382-c377f021c6fa'] Sep 27 04:20:46.599284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:46Z,description=,direction='egress',ethertype='IPv4',id=76c57ece-25ab-4d7a-8177-f2c8ad8fed2c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='17c0e187271d4aab948bd1d9395d35d3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=74a18fbc-0552-4596-8382-c377f021c6fa,updated_at=2022-09-27T04:20:46Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:46.599834 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (76c57ece-25ab-4d7a-8177-f2c8ad8fed2c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.601008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Security group rule updated ['74a18fbc-0552-4596-8382-c377f021c6fa'] Sep 27 04:20:46.601954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:46Z,description=,direction='egress',ethertype='IPv6',id=b685378e-f78f-4eae-8fa3-f61b2fc004ec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='17c0e187271d4aab948bd1d9395d35d3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=74a18fbc-0552-4596-8382-c377f021c6fa,updated_at=2022-09-27T04:20:46Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:46.603099 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b685378e-f78f-4eae-8fa3-f61b2fc004ec), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.603865 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Security group rule updated ['74a18fbc-0552-4596-8382-c377f021c6fa'] Sep 27 04:20:46.604733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:46Z,description=,direction='ingress',ethertype='IPv6',id=d3fc0ffc-6b72-4d9f-aac1-467c7666ad0a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='17c0e187271d4aab948bd1d9395d35d3',protocol=,remote_address_group_id=,remote_group_id=74a18fbc-0552-4596-8382-c377f021c6fa,remote_ip_prefix=,revision_number=0,security_group_id=74a18fbc-0552-4596-8382-c377f021c6fa,updated_at=2022-09-27T04:20:46Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:46.606365 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d3fc0ffc-6b72-4d9f-aac1-467c7666ad0a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.607028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c977c48a-2e13-406b-b378-449aa5277918 admin admin] Security group rule updated ['74a18fbc-0552-4596-8382-c377f021c6fa'] Sep 27 04:20:46.621977 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Resource SecurityGroup deleted: 6cb63381-b96c-47f3-8cd0-df089223b964 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:46.622392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (6cb63381-b96c-47f3-8cd0-df089223b964), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.623016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6cb63381-b96c-47f3-8cd0-df089223b964',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:46.646744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6cb63381-b96c-47f3-8cd0-df089223b964',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:46.648696 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Resource SecurityGroupRule deleted: 355b325c-a768-4dda-9933-8bdb66ea065a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:46.649308 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (355b325c-a768-4dda-9933-8bdb66ea065a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.650849 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Security group rule updated ['6cb63381-b96c-47f3-8cd0-df089223b964'] Sep 27 04:20:46.651863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Resource SecurityGroupRule deleted: 6180a212-ceef-4953-916d-3d98f8515da2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:46.656634 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6180a212-ceef-4953-916d-3d98f8515da2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.657298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Security group rule updated ['6cb63381-b96c-47f3-8cd0-df089223b964'] Sep 27 04:20:46.659259 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Resource SecurityGroupRule deleted: ea0b05af-a7e7-432b-b773-8fff9aade179 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:46.659846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ea0b05af-a7e7-432b-b773-8fff9aade179), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.660445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Security group rule updated ['6cb63381-b96c-47f3-8cd0-df089223b964'] Sep 27 04:20:46.662838 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Resource SecurityGroupRule deleted: ec8c69e2-a60e-4c86-80af-1655359f3bd3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:46.663318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ec8c69e2-a60e-4c86-80af-1655359f3bd3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:46.664656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-666538d2-347c-4de7-89e5-dbb1ec3b4867 admin admin] Security group rule updated ['6cb63381-b96c-47f3-8cd0-df089223b964'] Sep 27 04:20:47.338631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Resource SecurityGroup deleted: 74a18fbc-0552-4596-8382-c377f021c6fa {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:47.339190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (74a18fbc-0552-4596-8382-c377f021c6fa), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:47.340309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('74a18fbc-0552-4596-8382-c377f021c6fa',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:47.355741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('74a18fbc-0552-4596-8382-c377f021c6fa',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:47.356359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Resource SecurityGroupRule deleted: 3b52ece1-a4fb-44fc-8900-5594e2f002ec {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:47.356829 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3b52ece1-a4fb-44fc-8900-5594e2f002ec), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:47.357675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Security group rule updated ['74a18fbc-0552-4596-8382-c377f021c6fa'] Sep 27 04:20:47.358423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Resource SecurityGroupRule deleted: 76c57ece-25ab-4d7a-8177-f2c8ad8fed2c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:47.358812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (76c57ece-25ab-4d7a-8177-f2c8ad8fed2c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:47.359243 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Security group rule updated ['74a18fbc-0552-4596-8382-c377f021c6fa'] Sep 27 04:20:47.359660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Resource SecurityGroupRule deleted: b685378e-f78f-4eae-8fa3-f61b2fc004ec {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:47.360197 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b685378e-f78f-4eae-8fa3-f61b2fc004ec), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:47.360560 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Security group rule updated ['74a18fbc-0552-4596-8382-c377f021c6fa'] Sep 27 04:20:47.361061 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Resource SecurityGroupRule deleted: d3fc0ffc-6b72-4d9f-aac1-467c7666ad0a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:47.361416 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d3fc0ffc-6b72-4d9f-aac1-467c7666ad0a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:47.361964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-332acf49-a0f5-46a5-9048-fdc25619c0a0 admin admin] Security group rule updated ['74a18fbc-0552-4596-8382-c377f021c6fa'] Sep 27 04:20:47.445191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:262 started Sep 27 04:20:47.447908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bf7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=272000000,duration_sec=537,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:47.448498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:47.448867 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:262 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:20:49.445844 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:263 started Sep 27 04:20:49.448532 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bf9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=272000000,duration_sec=539,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:49.449115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:49.449465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:263 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:20:51.446284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:264 started Sep 27 04:20:51.457971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bfb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=277000000,duration_sec=541,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:51.458624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:51.458986 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:264 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 27 04:20:53.447726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:265 started Sep 27 04:20:53.450849 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bfd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=274000000,duration_sec=543,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:53.451909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:53.452787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:265 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:20:54.928595 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:54Z,description='Default security group',id=e823b484-0ab1-4fdc-b422-51f3e4f1fbeb,is_default=True,name='default',project_id='8c7092bb4084473fa41466f1f4af3154',revision_number=1,rules=[SecurityGroupRule(51043fe6-b666-4e13-b5d7-c5e205690979),SecurityGroupRule(bf03c444-ff6b-43e4-bcb3-201bc3914717),SecurityGroupRule(c1c80077-74db-451e-9ac6-70ae0d6200db),SecurityGroupRule(f763a4bc-fa47-4227-9310-64fa37776577)],shared=False,stateful=True,updated_at=2022-09-27T04:20:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:54.929301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (e823b484-0ab1-4fdc-b422-51f3e4f1fbeb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:54.929663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:54Z,description=,direction='ingress',ethertype='IPv4',id=51043fe6-b666-4e13-b5d7-c5e205690979,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8c7092bb4084473fa41466f1f4af3154',protocol=,remote_address_group_id=,remote_group_id=e823b484-0ab1-4fdc-b422-51f3e4f1fbeb,remote_ip_prefix=,revision_number=0,security_group_id=e823b484-0ab1-4fdc-b422-51f3e4f1fbeb,updated_at=2022-09-27T04:20:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:54.930106 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (51043fe6-b666-4e13-b5d7-c5e205690979), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:54.930391 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Security group rule updated ['e823b484-0ab1-4fdc-b422-51f3e4f1fbeb'] Sep 27 04:20:54.931067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:54Z,description=,direction='egress',ethertype='IPv6',id=bf03c444-ff6b-43e4-bcb3-201bc3914717,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8c7092bb4084473fa41466f1f4af3154',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e823b484-0ab1-4fdc-b422-51f3e4f1fbeb,updated_at=2022-09-27T04:20:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:54.931424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (bf03c444-ff6b-43e4-bcb3-201bc3914717), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:54.931893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Security group rule updated ['e823b484-0ab1-4fdc-b422-51f3e4f1fbeb'] Sep 27 04:20:54.932519 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:54Z,description=,direction='ingress',ethertype='IPv6',id=c1c80077-74db-451e-9ac6-70ae0d6200db,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8c7092bb4084473fa41466f1f4af3154',protocol=,remote_address_group_id=,remote_group_id=e823b484-0ab1-4fdc-b422-51f3e4f1fbeb,remote_ip_prefix=,revision_number=0,security_group_id=e823b484-0ab1-4fdc-b422-51f3e4f1fbeb,updated_at=2022-09-27T04:20:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:54.932971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c1c80077-74db-451e-9ac6-70ae0d6200db), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:54.933303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Security group rule updated ['e823b484-0ab1-4fdc-b422-51f3e4f1fbeb'] Sep 27 04:20:54.934925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:54Z,description=,direction='egress',ethertype='IPv4',id=f763a4bc-fa47-4227-9310-64fa37776577,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8c7092bb4084473fa41466f1f4af3154',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e823b484-0ab1-4fdc-b422-51f3e4f1fbeb,updated_at=2022-09-27T04:20:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:54.934925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f763a4bc-fa47-4227-9310-64fa37776577), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:54.935366 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-382d1522-33d2-4a0a-9807-05ee9c63fbec admin admin] Security group rule updated ['e823b484-0ab1-4fdc-b422-51f3e4f1fbeb'] Sep 27 04:20:55.005121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:54Z,description='Default security group',id=722a8503-2c5d-4cb4-b352-1220fac58f0b,is_default=True,name='default',project_id='2729666a518f4303a2934950e17ffe57',revision_number=1,rules=[SecurityGroupRule(1e451561-8ddf-40f8-9dff-7bd57fd39583),SecurityGroupRule(69fcd491-866a-477b-aa05-1047989fd52e),SecurityGroupRule(84b7e26b-42c6-47f4-b561-fa8bca170f80),SecurityGroupRule(c0981b91-764e-4c1a-aff5-86e492d64856)],shared=False,stateful=True,updated_at=2022-09-27T04:20:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.005609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (722a8503-2c5d-4cb4-b352-1220fac58f0b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.006349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:54Z,description=,direction='egress',ethertype='IPv6',id=1e451561-8ddf-40f8-9dff-7bd57fd39583,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2729666a518f4303a2934950e17ffe57',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=722a8503-2c5d-4cb4-b352-1220fac58f0b,updated_at=2022-09-27T04:20:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.006828 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1e451561-8ddf-40f8-9dff-7bd57fd39583), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.007536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Security group rule updated ['722a8503-2c5d-4cb4-b352-1220fac58f0b'] Sep 27 04:20:55.008312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:54Z,description=,direction='ingress',ethertype='IPv4',id=69fcd491-866a-477b-aa05-1047989fd52e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2729666a518f4303a2934950e17ffe57',protocol=,remote_address_group_id=,remote_group_id=722a8503-2c5d-4cb4-b352-1220fac58f0b,remote_ip_prefix=,revision_number=0,security_group_id=722a8503-2c5d-4cb4-b352-1220fac58f0b,updated_at=2022-09-27T04:20:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.008736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (69fcd491-866a-477b-aa05-1047989fd52e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.009138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Security group rule updated ['722a8503-2c5d-4cb4-b352-1220fac58f0b'] Sep 27 04:20:55.009906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:54Z,description=,direction='egress',ethertype='IPv4',id=84b7e26b-42c6-47f4-b561-fa8bca170f80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2729666a518f4303a2934950e17ffe57',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=722a8503-2c5d-4cb4-b352-1220fac58f0b,updated_at=2022-09-27T04:20:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.010687 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (84b7e26b-42c6-47f4-b561-fa8bca170f80), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.011244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Security group rule updated ['722a8503-2c5d-4cb4-b352-1220fac58f0b'] Sep 27 04:20:55.012772 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:54Z,description=,direction='ingress',ethertype='IPv6',id=c0981b91-764e-4c1a-aff5-86e492d64856,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2729666a518f4303a2934950e17ffe57',protocol=,remote_address_group_id=,remote_group_id=722a8503-2c5d-4cb4-b352-1220fac58f0b,remote_ip_prefix=,revision_number=0,security_group_id=722a8503-2c5d-4cb4-b352-1220fac58f0b,updated_at=2022-09-27T04:20:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.013365 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c0981b91-764e-4c1a-aff5-86e492d64856), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.013777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5280eec3-0ca1-4cc4-b047-8f514e36a3d3 admin admin] Security group rule updated ['722a8503-2c5d-4cb4-b352-1220fac58f0b'] Sep 27 04:20:55.161274 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Resource SecurityGroup deleted: 722a8503-2c5d-4cb4-b352-1220fac58f0b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.162052 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (722a8503-2c5d-4cb4-b352-1220fac58f0b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.163451 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('722a8503-2c5d-4cb4-b352-1220fac58f0b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:55.184463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('722a8503-2c5d-4cb4-b352-1220fac58f0b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:55.185340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Resource SecurityGroupRule deleted: 1e451561-8ddf-40f8-9dff-7bd57fd39583 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.186102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1e451561-8ddf-40f8-9dff-7bd57fd39583), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.187014 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Security group rule updated ['722a8503-2c5d-4cb4-b352-1220fac58f0b'] Sep 27 04:20:55.187524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Resource SecurityGroupRule deleted: 69fcd491-866a-477b-aa05-1047989fd52e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.188948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (69fcd491-866a-477b-aa05-1047989fd52e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.191094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Security group rule updated ['722a8503-2c5d-4cb4-b352-1220fac58f0b'] Sep 27 04:20:55.191732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Resource SecurityGroupRule deleted: 84b7e26b-42c6-47f4-b561-fa8bca170f80 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.192441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (84b7e26b-42c6-47f4-b561-fa8bca170f80), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.192872 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Security group rule updated ['722a8503-2c5d-4cb4-b352-1220fac58f0b'] Sep 27 04:20:55.194174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Resource SecurityGroupRule deleted: c0981b91-764e-4c1a-aff5-86e492d64856 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.195060 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c0981b91-764e-4c1a-aff5-86e492d64856), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.195729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ff09f42e-18f0-4350-a9d3-009d60623c60 admin admin] Security group rule updated ['722a8503-2c5d-4cb4-b352-1220fac58f0b'] Sep 27 04:20:55.215827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Resource SecurityGroup deleted: e823b484-0ab1-4fdc-b422-51f3e4f1fbeb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.217188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (e823b484-0ab1-4fdc-b422-51f3e4f1fbeb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.218507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e823b484-0ab1-4fdc-b422-51f3e4f1fbeb',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:55.237503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e823b484-0ab1-4fdc-b422-51f3e4f1fbeb',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:55.238250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Resource SecurityGroupRule deleted: 51043fe6-b666-4e13-b5d7-c5e205690979 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.238832 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (51043fe6-b666-4e13-b5d7-c5e205690979), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.239269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Security group rule updated ['e823b484-0ab1-4fdc-b422-51f3e4f1fbeb'] Sep 27 04:20:55.239918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Resource SecurityGroupRule deleted: bf03c444-ff6b-43e4-bcb3-201bc3914717 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.240550 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (bf03c444-ff6b-43e4-bcb3-201bc3914717), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.241293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Security group rule updated ['e823b484-0ab1-4fdc-b422-51f3e4f1fbeb'] Sep 27 04:20:55.241936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Resource SecurityGroupRule deleted: c1c80077-74db-451e-9ac6-70ae0d6200db {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.242623 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c1c80077-74db-451e-9ac6-70ae0d6200db), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.243309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Security group rule updated ['e823b484-0ab1-4fdc-b422-51f3e4f1fbeb'] Sep 27 04:20:55.244220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Resource SecurityGroupRule deleted: f763a4bc-fa47-4227-9310-64fa37776577 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.245286 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f763a4bc-fa47-4227-9310-64fa37776577), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.246560 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4082abcc-4307-4e63-931f-05c6cfe44692 admin admin] Security group rule updated ['e823b484-0ab1-4fdc-b422-51f3e4f1fbeb'] Sep 27 04:20:55.449267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:266 started Sep 27 04:20:55.451934 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22bff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=276000000,duration_sec=545,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:55.453724 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:55.454191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:266 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:20:55.650494 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:55Z,description='Default security group',id=9f175a70-8cff-4b45-b979-0f14b7a60098,is_default=True,name='default',project_id='40ed12f0e3414ab393dd77ced315a36b',revision_number=1,rules=[SecurityGroupRule(52e65463-04ab-464d-99f4-66ef1a63dc39),SecurityGroupRule(555c7da9-ef19-4b05-9582-d317d086bc7f),SecurityGroupRule(7666bdc7-55fc-4067-a2b4-392c88394bb9),SecurityGroupRule(be19badc-aae3-4674-a537-2d63cd64a0c8)],shared=False,stateful=True,updated_at=2022-09-27T04:20:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.655395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (9f175a70-8cff-4b45-b979-0f14b7a60098), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.656929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:55Z,description=,direction='egress',ethertype='IPv4',id=52e65463-04ab-464d-99f4-66ef1a63dc39,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40ed12f0e3414ab393dd77ced315a36b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9f175a70-8cff-4b45-b979-0f14b7a60098,updated_at=2022-09-27T04:20:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.658278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (52e65463-04ab-464d-99f4-66ef1a63dc39), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.660016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Security group rule updated ['9f175a70-8cff-4b45-b979-0f14b7a60098'] Sep 27 04:20:55.661983 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:55Z,description=,direction='ingress',ethertype='IPv4',id=555c7da9-ef19-4b05-9582-d317d086bc7f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40ed12f0e3414ab393dd77ced315a36b',protocol=,remote_address_group_id=,remote_group_id=9f175a70-8cff-4b45-b979-0f14b7a60098,remote_ip_prefix=,revision_number=0,security_group_id=9f175a70-8cff-4b45-b979-0f14b7a60098,updated_at=2022-09-27T04:20:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.662762 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (555c7da9-ef19-4b05-9582-d317d086bc7f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.664665 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Security group rule updated ['9f175a70-8cff-4b45-b979-0f14b7a60098'] Sep 27 04:20:55.666882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:55Z,description=,direction='egress',ethertype='IPv6',id=7666bdc7-55fc-4067-a2b4-392c88394bb9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40ed12f0e3414ab393dd77ced315a36b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9f175a70-8cff-4b45-b979-0f14b7a60098,updated_at=2022-09-27T04:20:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.667471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7666bdc7-55fc-4067-a2b4-392c88394bb9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.667820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Security group rule updated ['9f175a70-8cff-4b45-b979-0f14b7a60098'] Sep 27 04:20:55.675434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:55Z,description=,direction='ingress',ethertype='IPv6',id=be19badc-aae3-4674-a537-2d63cd64a0c8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='40ed12f0e3414ab393dd77ced315a36b',protocol=,remote_address_group_id=,remote_group_id=9f175a70-8cff-4b45-b979-0f14b7a60098,remote_ip_prefix=,revision_number=0,security_group_id=9f175a70-8cff-4b45-b979-0f14b7a60098,updated_at=2022-09-27T04:20:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.676560 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (be19badc-aae3-4674-a537-2d63cd64a0c8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.676875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e1de5721-e327-4b73-bf56-3b9f39d16648 admin admin] Security group rule updated ['9f175a70-8cff-4b45-b979-0f14b7a60098'] Sep 27 04:20:55.685510 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:55Z,description='Default security group',id=b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3,is_default=True,name='default',project_id='88d7c063eb474468a8bf3fbc131c3b0f',revision_number=1,rules=[SecurityGroupRule(21931cdb-d4b8-423e-b105-ad117aa62acc),SecurityGroupRule(3e7c91a4-2f85-480b-ac66-6cba93b3f2f7),SecurityGroupRule(4fc9b706-fb78-4d14-aa2c-57754d7fd35a),SecurityGroupRule(7bff103a-47b4-4bd5-934d-6d207c3a56e8)],shared=False,stateful=True,updated_at=2022-09-27T04:20:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.685961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.687169 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:55Z,description=,direction='ingress',ethertype='IPv4',id=21931cdb-d4b8-423e-b105-ad117aa62acc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88d7c063eb474468a8bf3fbc131c3b0f',protocol=,remote_address_group_id=,remote_group_id=b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3,remote_ip_prefix=,revision_number=0,security_group_id=b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3,updated_at=2022-09-27T04:20:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.687602 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (21931cdb-d4b8-423e-b105-ad117aa62acc), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.687954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Security group rule updated ['b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3'] Sep 27 04:20:55.688672 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:55Z,description=,direction='egress',ethertype='IPv4',id=3e7c91a4-2f85-480b-ac66-6cba93b3f2f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88d7c063eb474468a8bf3fbc131c3b0f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3,updated_at=2022-09-27T04:20:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.689047 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3e7c91a4-2f85-480b-ac66-6cba93b3f2f7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.689379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Security group rule updated ['b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3'] Sep 27 04:20:55.690469 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:55Z,description=,direction='egress',ethertype='IPv6',id=4fc9b706-fb78-4d14-aa2c-57754d7fd35a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88d7c063eb474468a8bf3fbc131c3b0f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3,updated_at=2022-09-27T04:20:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.690831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4fc9b706-fb78-4d14-aa2c-57754d7fd35a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.691172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Security group rule updated ['b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3'] Sep 27 04:20:55.697495 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:55Z,description=,direction='ingress',ethertype='IPv6',id=7bff103a-47b4-4bd5-934d-6d207c3a56e8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='88d7c063eb474468a8bf3fbc131c3b0f',protocol=,remote_address_group_id=,remote_group_id=b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3,remote_ip_prefix=,revision_number=0,security_group_id=b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3,updated_at=2022-09-27T04:20:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:55.698101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7bff103a-47b4-4bd5-934d-6d207c3a56e8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.698450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-433ed75e-8749-4615-b769-24d05a66a2fe admin admin] Security group rule updated ['b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3'] Sep 27 04:20:55.926756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Resource SecurityGroup deleted: 9f175a70-8cff-4b45-b979-0f14b7a60098 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.927393 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (9f175a70-8cff-4b45-b979-0f14b7a60098), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.928058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9f175a70-8cff-4b45-b979-0f14b7a60098',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:55.940034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Resource SecurityGroup deleted: b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.941035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.941733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:55.947930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9f175a70-8cff-4b45-b979-0f14b7a60098',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:55.948421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Resource SecurityGroupRule deleted: 52e65463-04ab-464d-99f4-66ef1a63dc39 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.948800 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (52e65463-04ab-464d-99f4-66ef1a63dc39), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.949138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Security group rule updated ['9f175a70-8cff-4b45-b979-0f14b7a60098'] Sep 27 04:20:55.951404 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Resource SecurityGroupRule deleted: 555c7da9-ef19-4b05-9582-d317d086bc7f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.953936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (555c7da9-ef19-4b05-9582-d317d086bc7f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.954568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Security group rule updated ['9f175a70-8cff-4b45-b979-0f14b7a60098'] Sep 27 04:20:55.955121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Resource SecurityGroupRule deleted: 7666bdc7-55fc-4067-a2b4-392c88394bb9 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.956084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7666bdc7-55fc-4067-a2b4-392c88394bb9), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.956577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Security group rule updated ['9f175a70-8cff-4b45-b979-0f14b7a60098'] Sep 27 04:20:55.957122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Resource SecurityGroupRule deleted: be19badc-aae3-4674-a537-2d63cd64a0c8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.958103 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (be19badc-aae3-4674-a537-2d63cd64a0c8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.958609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-03de53a1-be5d-480b-a523-b378022b82a4 admin admin] Security group rule updated ['9f175a70-8cff-4b45-b979-0f14b7a60098'] Sep 27 04:20:55.960990 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:55.961617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Resource SecurityGroupRule deleted: 21931cdb-d4b8-423e-b105-ad117aa62acc {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.962184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (21931cdb-d4b8-423e-b105-ad117aa62acc), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.962664 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Security group rule updated ['b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3'] Sep 27 04:20:55.963210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Resource SecurityGroupRule deleted: 3e7c91a4-2f85-480b-ac66-6cba93b3f2f7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.963716 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3e7c91a4-2f85-480b-ac66-6cba93b3f2f7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.964204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Security group rule updated ['b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3'] Sep 27 04:20:55.964748 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Resource SecurityGroupRule deleted: 4fc9b706-fb78-4d14-aa2c-57754d7fd35a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.965374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4fc9b706-fb78-4d14-aa2c-57754d7fd35a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.966709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Security group rule updated ['b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3'] Sep 27 04:20:55.967100 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Resource SecurityGroupRule deleted: 7bff103a-47b4-4bd5-934d-6d207c3a56e8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:55.967451 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7bff103a-47b4-4bd5-934d-6d207c3a56e8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:55.967812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-861ad2ff-047c-4dcf-a405-c915d560c0ba admin admin] Security group rule updated ['b3cb7a07-62e2-4226-b82d-b3dc9cccd8d3'] Sep 27 04:20:57.388200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-664ddd67-b18b-4a28-b6bc-6ea27e5b7665 tempest-DeleteServersTestJSON-1833106251 tempest-DeleteServersTestJSON-1833106251-project] Resource Port deleted: acd21fd8-866c-4c10-9697-2fe37ef43cf1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:57.388773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-664ddd67-b18b-4a28-b6bc-6ea27e5b7665 tempest-DeleteServersTestJSON-1833106251 tempest-DeleteServersTestJSON-1833106251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (acd21fd8-866c-4c10-9697-2fe37ef43cf1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:57.389322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-664ddd67-b18b-4a28-b6bc-6ea27e5b7665 tempest-DeleteServersTestJSON-1833106251 tempest-DeleteServersTestJSON-1833106251-project] Security group member updated {'6292e5d4-a4a9-48a7-955f-6a9e34544572'} Sep 27 04:20:57.449398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:267 started Sep 27 04:20:57.452674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c01,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=277000000,duration_sec=547,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:57.453272 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:57.453609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:267 - starting polling. Elapsed:0.004 Sep 27 04:20:57.455793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:57.457359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port acd21fd8-866c-4c10-9697-2fe37ef43cf1 not present in bridge br-int Sep 27 04:20:57.458397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:20:57.458748 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['acd21fd8-866c-4c10-9697-2fe37ef43cf1'] Sep 27 04:20:57.459069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port acd21fd8-866c-4c10-9697-2fe37ef43cf1 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:20:57.465767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:267 - port information retrieved. Elapsed:0.016 Sep 27 04:20:57.466125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:267 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 27 04:20:59.349928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:59Z,description='Default security group',id=0b0c3419-a8fe-4d70-8856-cf5f83491838,is_default=True,name='default',project_id='3690b5efde2e4646ae992f5599eadb2f',revision_number=1,rules=[SecurityGroupRule(13aabb76-f16f-437e-b829-89175b9cd8f9),SecurityGroupRule(b086d33a-5e96-4905-9b8c-d737702b786b),SecurityGroupRule(e574527c-cdd9-4450-ae91-a1cfd27b3c11),SecurityGroupRule(ff3f4cce-d77b-47a0-88c4-71bff0b4ac2e)],shared=False,stateful=True,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:59.351585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (0b0c3419-a8fe-4d70-8856-cf5f83491838), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.352557 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='ingress',ethertype='IPv6',id=13aabb76-f16f-437e-b829-89175b9cd8f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3690b5efde2e4646ae992f5599eadb2f',protocol=,remote_address_group_id=,remote_group_id=0b0c3419-a8fe-4d70-8856-cf5f83491838,remote_ip_prefix=,revision_number=0,security_group_id=0b0c3419-a8fe-4d70-8856-cf5f83491838,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:59.353089 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (13aabb76-f16f-437e-b829-89175b9cd8f9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.353899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Security group rule updated ['0b0c3419-a8fe-4d70-8856-cf5f83491838'] Sep 27 04:20:59.357309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='egress',ethertype='IPv6',id=b086d33a-5e96-4905-9b8c-d737702b786b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3690b5efde2e4646ae992f5599eadb2f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0b0c3419-a8fe-4d70-8856-cf5f83491838,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:59.357953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b086d33a-5e96-4905-9b8c-d737702b786b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.359179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Security group rule updated ['0b0c3419-a8fe-4d70-8856-cf5f83491838'] Sep 27 04:20:59.360020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='egress',ethertype='IPv4',id=e574527c-cdd9-4450-ae91-a1cfd27b3c11,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3690b5efde2e4646ae992f5599eadb2f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0b0c3419-a8fe-4d70-8856-cf5f83491838,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:59.368174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e574527c-cdd9-4450-ae91-a1cfd27b3c11), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.368747 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Security group rule updated ['0b0c3419-a8fe-4d70-8856-cf5f83491838'] Sep 27 04:20:59.369844 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='ingress',ethertype='IPv4',id=ff3f4cce-d77b-47a0-88c4-71bff0b4ac2e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3690b5efde2e4646ae992f5599eadb2f',protocol=,remote_address_group_id=,remote_group_id=0b0c3419-a8fe-4d70-8856-cf5f83491838,remote_ip_prefix=,revision_number=0,security_group_id=0b0c3419-a8fe-4d70-8856-cf5f83491838,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:59.370440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ff3f4cce-d77b-47a0-88c4-71bff0b4ac2e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.370967 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-185a2fed-3630-4491-8219-150c26ff9d2d admin admin] Security group rule updated ['0b0c3419-a8fe-4d70-8856-cf5f83491838'] Sep 27 04:20:59.452526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:268 started Sep 27 04:20:59.455939 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c03,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=280000000,duration_sec=549,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:20:59.456521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:20:59.456875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:268 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:20:59.551078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Resource SecurityGroup deleted: 0b0c3419-a8fe-4d70-8856-cf5f83491838 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:59.552059 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (0b0c3419-a8fe-4d70-8856-cf5f83491838), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.553123 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0b0c3419-a8fe-4d70-8856-cf5f83491838',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:59.568894 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0b0c3419-a8fe-4d70-8856-cf5f83491838',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:59.569423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Resource SecurityGroupRule deleted: 13aabb76-f16f-437e-b829-89175b9cd8f9 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:59.570074 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (13aabb76-f16f-437e-b829-89175b9cd8f9), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.570623 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Security group rule updated ['0b0c3419-a8fe-4d70-8856-cf5f83491838'] Sep 27 04:20:59.571367 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Resource SecurityGroupRule deleted: b086d33a-5e96-4905-9b8c-d737702b786b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:59.571717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b086d33a-5e96-4905-9b8c-d737702b786b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.572239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Security group rule updated ['0b0c3419-a8fe-4d70-8856-cf5f83491838'] Sep 27 04:20:59.572885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Resource SecurityGroupRule deleted: e574527c-cdd9-4450-ae91-a1cfd27b3c11 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:59.573243 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e574527c-cdd9-4450-ae91-a1cfd27b3c11), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.573661 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Security group rule updated ['0b0c3419-a8fe-4d70-8856-cf5f83491838'] Sep 27 04:20:59.574082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Resource SecurityGroupRule deleted: ff3f4cce-d77b-47a0-88c4-71bff0b4ac2e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:59.574427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ff3f4cce-d77b-47a0-88c4-71bff0b4ac2e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.574746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ae18ecb1-0196-4d1a-92d1-7937abfd7ef6 admin admin] Security group rule updated ['0b0c3419-a8fe-4d70-8856-cf5f83491838'] Sep 27 04:20:59.671958 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:59Z,description='Default security group',id=5eb9083f-a751-4ddb-a7c1-5268e908b4b4,is_default=True,name='default',project_id='982e342f1e1f49c7b5c7586650c5394b',revision_number=1,rules=[SecurityGroupRule(18c96828-642e-429f-9932-8fc985820ab2),SecurityGroupRule(7749871f-a6a0-463b-9959-b4249d8f0f9d),SecurityGroupRule(b2091b6c-bf57-4335-a5ac-2d8cc0073436),SecurityGroupRule(ee57b1da-f2e5-4d53-a468-d95580fe3767)],shared=False,stateful=True,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:59.672350 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (5eb9083f-a751-4ddb-a7c1-5268e908b4b4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.672987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='ingress',ethertype='IPv4',id=18c96828-642e-429f-9932-8fc985820ab2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='982e342f1e1f49c7b5c7586650c5394b',protocol=,remote_address_group_id=,remote_group_id=5eb9083f-a751-4ddb-a7c1-5268e908b4b4,remote_ip_prefix=,revision_number=0,security_group_id=5eb9083f-a751-4ddb-a7c1-5268e908b4b4,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:59.673348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (18c96828-642e-429f-9932-8fc985820ab2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.673681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Security group rule updated ['5eb9083f-a751-4ddb-a7c1-5268e908b4b4'] Sep 27 04:20:59.674421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='ingress',ethertype='IPv6',id=7749871f-a6a0-463b-9959-b4249d8f0f9d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='982e342f1e1f49c7b5c7586650c5394b',protocol=,remote_address_group_id=,remote_group_id=5eb9083f-a751-4ddb-a7c1-5268e908b4b4,remote_ip_prefix=,revision_number=0,security_group_id=5eb9083f-a751-4ddb-a7c1-5268e908b4b4,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:59.674948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7749871f-a6a0-463b-9959-b4249d8f0f9d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.675273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Security group rule updated ['5eb9083f-a751-4ddb-a7c1-5268e908b4b4'] Sep 27 04:20:59.676070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='egress',ethertype='IPv4',id=b2091b6c-bf57-4335-a5ac-2d8cc0073436,normalized_cidr=None,port_range_max=,port_range_min=,project_id='982e342f1e1f49c7b5c7586650c5394b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5eb9083f-a751-4ddb-a7c1-5268e908b4b4,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:59.676428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b2091b6c-bf57-4335-a5ac-2d8cc0073436), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.676748 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Security group rule updated ['5eb9083f-a751-4ddb-a7c1-5268e908b4b4'] Sep 27 04:20:59.677548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='egress',ethertype='IPv6',id=ee57b1da-f2e5-4d53-a468-d95580fe3767,normalized_cidr=None,port_range_max=,port_range_min=,project_id='982e342f1e1f49c7b5c7586650c5394b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5eb9083f-a751-4ddb-a7c1-5268e908b4b4,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:20:59.677929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ee57b1da-f2e5-4d53-a468-d95580fe3767), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.678251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2523fb37-c14c-4c0c-95be-31d4773b41e0 admin admin] Security group rule updated ['5eb9083f-a751-4ddb-a7c1-5268e908b4b4'] Sep 27 04:20:59.833917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Resource SecurityGroup deleted: 5eb9083f-a751-4ddb-a7c1-5268e908b4b4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:59.834687 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (5eb9083f-a751-4ddb-a7c1-5268e908b4b4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.835239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5eb9083f-a751-4ddb-a7c1-5268e908b4b4',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:20:59.856426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5eb9083f-a751-4ddb-a7c1-5268e908b4b4',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:20:59.857239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Resource SecurityGroupRule deleted: 18c96828-642e-429f-9932-8fc985820ab2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:59.857805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (18c96828-642e-429f-9932-8fc985820ab2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.858516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Security group rule updated ['5eb9083f-a751-4ddb-a7c1-5268e908b4b4'] Sep 27 04:20:59.859214 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Resource SecurityGroupRule deleted: 7749871f-a6a0-463b-9959-b4249d8f0f9d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:59.859847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7749871f-a6a0-463b-9959-b4249d8f0f9d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.860681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Security group rule updated ['5eb9083f-a751-4ddb-a7c1-5268e908b4b4'] Sep 27 04:20:59.861285 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Resource SecurityGroupRule deleted: b2091b6c-bf57-4335-a5ac-2d8cc0073436 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:59.862210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b2091b6c-bf57-4335-a5ac-2d8cc0073436), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.862637 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Security group rule updated ['5eb9083f-a751-4ddb-a7c1-5268e908b4b4'] Sep 27 04:20:59.863111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Resource SecurityGroupRule deleted: ee57b1da-f2e5-4d53-a468-d95580fe3767 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:20:59.863516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ee57b1da-f2e5-4d53-a468-d95580fe3767), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:20:59.864717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0a73fec5-6544-4568-a171-af61f5bdccbd admin admin] Security group rule updated ['5eb9083f-a751-4ddb-a7c1-5268e908b4b4'] Sep 27 04:21:00.057403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:20:59Z,description='Default security group',id=093b3c9b-4dd7-4ec4-9281-92ac2303055e,is_default=True,name='default',project_id='0716bfc7dc944ea0804a8631b5b066e0',revision_number=1,rules=[SecurityGroupRule(218c4ae3-0163-48af-b77f-142bd0f3ddfa),SecurityGroupRule(2aebf027-2dc8-4b26-8e96-d91ae2903a3e),SecurityGroupRule(482ab096-fd49-4d70-9104-a70a186ce401),SecurityGroupRule(a9b96a25-ca31-4a2e-9c35-8798e9903bef)],shared=False,stateful=True,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.057974 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (093b3c9b-4dd7-4ec4-9281-92ac2303055e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.058900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='ingress',ethertype='IPv6',id=218c4ae3-0163-48af-b77f-142bd0f3ddfa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0716bfc7dc944ea0804a8631b5b066e0',protocol=,remote_address_group_id=,remote_group_id=093b3c9b-4dd7-4ec4-9281-92ac2303055e,remote_ip_prefix=,revision_number=0,security_group_id=093b3c9b-4dd7-4ec4-9281-92ac2303055e,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.059637 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (218c4ae3-0163-48af-b77f-142bd0f3ddfa), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.060385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Security group rule updated ['093b3c9b-4dd7-4ec4-9281-92ac2303055e'] Sep 27 04:21:00.061854 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='egress',ethertype='IPv4',id=2aebf027-2dc8-4b26-8e96-d91ae2903a3e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0716bfc7dc944ea0804a8631b5b066e0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=093b3c9b-4dd7-4ec4-9281-92ac2303055e,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.062432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2aebf027-2dc8-4b26-8e96-d91ae2903a3e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.062938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Security group rule updated ['093b3c9b-4dd7-4ec4-9281-92ac2303055e'] Sep 27 04:21:00.063752 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='ingress',ethertype='IPv4',id=482ab096-fd49-4d70-9104-a70a186ce401,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0716bfc7dc944ea0804a8631b5b066e0',protocol=,remote_address_group_id=,remote_group_id=093b3c9b-4dd7-4ec4-9281-92ac2303055e,remote_ip_prefix=,revision_number=0,security_group_id=093b3c9b-4dd7-4ec4-9281-92ac2303055e,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.064318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (482ab096-fd49-4d70-9104-a70a186ce401), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.064808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Security group rule updated ['093b3c9b-4dd7-4ec4-9281-92ac2303055e'] Sep 27 04:21:00.066947 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:20:59Z,description=,direction='egress',ethertype='IPv6',id=a9b96a25-ca31-4a2e-9c35-8798e9903bef,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0716bfc7dc944ea0804a8631b5b066e0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=093b3c9b-4dd7-4ec4-9281-92ac2303055e,updated_at=2022-09-27T04:20:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.067514 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a9b96a25-ca31-4a2e-9c35-8798e9903bef), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.068455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4dbac286-7982-42d0-923d-0e8c4bf4810b admin admin] Security group rule updated ['093b3c9b-4dd7-4ec4-9281-92ac2303055e'] Sep 27 04:21:00.283517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Resource SecurityGroup deleted: 093b3c9b-4dd7-4ec4-9281-92ac2303055e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:00.283517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (093b3c9b-4dd7-4ec4-9281-92ac2303055e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.285230 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('093b3c9b-4dd7-4ec4-9281-92ac2303055e',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:00.306687 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('093b3c9b-4dd7-4ec4-9281-92ac2303055e',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:00.307387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Resource SecurityGroupRule deleted: 218c4ae3-0163-48af-b77f-142bd0f3ddfa {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:00.309299 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (218c4ae3-0163-48af-b77f-142bd0f3ddfa), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.309874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Security group rule updated ['093b3c9b-4dd7-4ec4-9281-92ac2303055e'] Sep 27 04:21:00.310427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Resource SecurityGroupRule deleted: 2aebf027-2dc8-4b26-8e96-d91ae2903a3e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:00.312787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2aebf027-2dc8-4b26-8e96-d91ae2903a3e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.313872 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Security group rule updated ['093b3c9b-4dd7-4ec4-9281-92ac2303055e'] Sep 27 04:21:00.315163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Resource SecurityGroupRule deleted: 482ab096-fd49-4d70-9104-a70a186ce401 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:00.315993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (482ab096-fd49-4d70-9104-a70a186ce401), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.316524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Security group rule updated ['093b3c9b-4dd7-4ec4-9281-92ac2303055e'] Sep 27 04:21:00.317076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Resource SecurityGroupRule deleted: a9b96a25-ca31-4a2e-9c35-8798e9903bef {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:00.318526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a9b96a25-ca31-4a2e-9c35-8798e9903bef), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.319256 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b8e4f99c-4d70-49c6-8035-65d5ad200183 admin admin] Security group rule updated ['093b3c9b-4dd7-4ec4-9281-92ac2303055e'] Sep 27 04:21:00.541165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:00Z,description='Default security group',id=3c613343-9a7d-4800-87e1-dc033f375fc3,is_default=True,name='default',project_id='769231fa56cf43228509a0a783d7d28d',revision_number=1,rules=[SecurityGroupRule(027f40b5-17a2-407c-97b4-4e870428b74b),SecurityGroupRule(6f6cc051-8da5-4b8a-a13b-505760536bb4),SecurityGroupRule(8fbdbaff-02b5-40c1-9f50-b6340b46887b),SecurityGroupRule(a30a472c-7d72-4bb4-bbed-96ecece10b41)],shared=False,stateful=True,updated_at=2022-09-27T04:21:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.541838 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (3c613343-9a7d-4800-87e1-dc033f375fc3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.542214 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:00Z,description=,direction='egress',ethertype='IPv4',id=027f40b5-17a2-407c-97b4-4e870428b74b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='769231fa56cf43228509a0a783d7d28d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3c613343-9a7d-4800-87e1-dc033f375fc3,updated_at=2022-09-27T04:21:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.542578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (027f40b5-17a2-407c-97b4-4e870428b74b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.542958 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Security group rule updated ['3c613343-9a7d-4800-87e1-dc033f375fc3'] Sep 27 04:21:00.543675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:00Z,description=,direction='ingress',ethertype='IPv6',id=6f6cc051-8da5-4b8a-a13b-505760536bb4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='769231fa56cf43228509a0a783d7d28d',protocol=,remote_address_group_id=,remote_group_id=3c613343-9a7d-4800-87e1-dc033f375fc3,remote_ip_prefix=,revision_number=0,security_group_id=3c613343-9a7d-4800-87e1-dc033f375fc3,updated_at=2022-09-27T04:21:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.544369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6f6cc051-8da5-4b8a-a13b-505760536bb4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.544369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Security group rule updated ['3c613343-9a7d-4800-87e1-dc033f375fc3'] Sep 27 04:21:00.545091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:00Z,description=,direction='ingress',ethertype='IPv4',id=8fbdbaff-02b5-40c1-9f50-b6340b46887b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='769231fa56cf43228509a0a783d7d28d',protocol=,remote_address_group_id=,remote_group_id=3c613343-9a7d-4800-87e1-dc033f375fc3,remote_ip_prefix=,revision_number=0,security_group_id=3c613343-9a7d-4800-87e1-dc033f375fc3,updated_at=2022-09-27T04:21:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.546727 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8fbdbaff-02b5-40c1-9f50-b6340b46887b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.547278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Security group rule updated ['3c613343-9a7d-4800-87e1-dc033f375fc3'] Sep 27 04:21:00.548090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:00Z,description=,direction='egress',ethertype='IPv6',id=a30a472c-7d72-4bb4-bbed-96ecece10b41,normalized_cidr=None,port_range_max=,port_range_min=,project_id='769231fa56cf43228509a0a783d7d28d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3c613343-9a7d-4800-87e1-dc033f375fc3,updated_at=2022-09-27T04:21:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.550518 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a30a472c-7d72-4bb4-bbed-96ecece10b41), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.551071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9887a5ab-0127-4f23-b259-9ec509085581 admin admin] Security group rule updated ['3c613343-9a7d-4800-87e1-dc033f375fc3'] Sep 27 04:21:00.951518 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:00Z,description='Default security group',id=b8458589-3fcc-4e90-a581-3edad5cbc25f,is_default=True,name='default',project_id='a0b62143bb2c44e39402a5483e0c75d2',revision_number=1,rules=[SecurityGroupRule(420eff1e-7319-4c7e-8499-e7d35507c30e),SecurityGroupRule(761c68cf-213c-4fdf-9865-067822506e27),SecurityGroupRule(8b2e231c-21cc-47a3-a6b3-46349d297462),SecurityGroupRule(d1546ecb-0891-4133-8ad4-d84cbc5e6a38)],shared=False,stateful=True,updated_at=2022-09-27T04:21:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.951919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (b8458589-3fcc-4e90-a581-3edad5cbc25f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.953268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:00Z,description=,direction='ingress',ethertype='IPv6',id=420eff1e-7319-4c7e-8499-e7d35507c30e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0b62143bb2c44e39402a5483e0c75d2',protocol=,remote_address_group_id=,remote_group_id=b8458589-3fcc-4e90-a581-3edad5cbc25f,remote_ip_prefix=,revision_number=0,security_group_id=b8458589-3fcc-4e90-a581-3edad5cbc25f,updated_at=2022-09-27T04:21:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.953623 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (420eff1e-7319-4c7e-8499-e7d35507c30e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.953969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Security group rule updated ['b8458589-3fcc-4e90-a581-3edad5cbc25f'] Sep 27 04:21:00.954617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:00Z,description=,direction='ingress',ethertype='IPv4',id=761c68cf-213c-4fdf-9865-067822506e27,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0b62143bb2c44e39402a5483e0c75d2',protocol=,remote_address_group_id=,remote_group_id=b8458589-3fcc-4e90-a581-3edad5cbc25f,remote_ip_prefix=,revision_number=0,security_group_id=b8458589-3fcc-4e90-a581-3edad5cbc25f,updated_at=2022-09-27T04:21:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.956298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (761c68cf-213c-4fdf-9865-067822506e27), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.956801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Security group rule updated ['b8458589-3fcc-4e90-a581-3edad5cbc25f'] Sep 27 04:21:00.958984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:00Z,description=,direction='egress',ethertype='IPv4',id=8b2e231c-21cc-47a3-a6b3-46349d297462,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0b62143bb2c44e39402a5483e0c75d2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b8458589-3fcc-4e90-a581-3edad5cbc25f,updated_at=2022-09-27T04:21:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.959349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8b2e231c-21cc-47a3-a6b3-46349d297462), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.959684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Security group rule updated ['b8458589-3fcc-4e90-a581-3edad5cbc25f'] Sep 27 04:21:00.960374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:00Z,description=,direction='egress',ethertype='IPv6',id=d1546ecb-0891-4133-8ad4-d84cbc5e6a38,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0b62143bb2c44e39402a5483e0c75d2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b8458589-3fcc-4e90-a581-3edad5cbc25f,updated_at=2022-09-27T04:21:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:00.960726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d1546ecb-0891-4133-8ad4-d84cbc5e6a38), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:00.961169 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-79047efd-8d10-4cf5-8ecc-29673b1d45ec admin admin] Security group rule updated ['b8458589-3fcc-4e90-a581-3edad5cbc25f'] Sep 27 04:21:01.031739 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Resource SecurityGroup deleted: 3c613343-9a7d-4800-87e1-dc033f375fc3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.032190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (3c613343-9a7d-4800-87e1-dc033f375fc3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:01.032712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3c613343-9a7d-4800-87e1-dc033f375fc3',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:01.046635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3c613343-9a7d-4800-87e1-dc033f375fc3',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:01.047114 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Resource SecurityGroupRule deleted: 027f40b5-17a2-407c-97b4-4e870428b74b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.047485 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (027f40b5-17a2-407c-97b4-4e870428b74b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:01.047817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Security group rule updated ['3c613343-9a7d-4800-87e1-dc033f375fc3'] Sep 27 04:21:01.048223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Resource SecurityGroupRule deleted: 6f6cc051-8da5-4b8a-a13b-505760536bb4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.048567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6f6cc051-8da5-4b8a-a13b-505760536bb4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:01.048886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Security group rule updated ['3c613343-9a7d-4800-87e1-dc033f375fc3'] Sep 27 04:21:01.049258 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Resource SecurityGroupRule deleted: 8fbdbaff-02b5-40c1-9f50-b6340b46887b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.049599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (8fbdbaff-02b5-40c1-9f50-b6340b46887b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:01.049940 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Security group rule updated ['3c613343-9a7d-4800-87e1-dc033f375fc3'] Sep 27 04:21:01.050308 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Resource SecurityGroupRule deleted: a30a472c-7d72-4bb4-bbed-96ecece10b41 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.050646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a30a472c-7d72-4bb4-bbed-96ecece10b41), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:01.050959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-13faacb7-66f3-418f-9ae2-398e21f343bb admin admin] Security group rule updated ['3c613343-9a7d-4800-87e1-dc033f375fc3'] Sep 27 04:21:01.428143 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Resource SecurityGroup deleted: b8458589-3fcc-4e90-a581-3edad5cbc25f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.428837 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (b8458589-3fcc-4e90-a581-3edad5cbc25f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:01.429541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b8458589-3fcc-4e90-a581-3edad5cbc25f',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:01.452746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:269 started Sep 27 04:21:01.453527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b8458589-3fcc-4e90-a581-3edad5cbc25f',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:01.454224 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Resource SecurityGroupRule deleted: 420eff1e-7319-4c7e-8499-e7d35507c30e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.454602 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (420eff1e-7319-4c7e-8499-e7d35507c30e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:01.455323 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Security group rule updated ['b8458589-3fcc-4e90-a581-3edad5cbc25f'] Sep 27 04:21:01.455812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Resource SecurityGroupRule deleted: 761c68cf-213c-4fdf-9865-067822506e27 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.460810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (761c68cf-213c-4fdf-9865-067822506e27), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:01.461179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Security group rule updated ['b8458589-3fcc-4e90-a581-3edad5cbc25f'] Sep 27 04:21:01.461578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Resource SecurityGroupRule deleted: 8b2e231c-21cc-47a3-a6b3-46349d297462 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.461989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (8b2e231c-21cc-47a3-a6b3-46349d297462), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:01.462712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Security group rule updated ['b8458589-3fcc-4e90-a581-3edad5cbc25f'] Sep 27 04:21:01.462712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Resource SecurityGroupRule deleted: d1546ecb-0891-4133-8ad4-d84cbc5e6a38 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.463019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d1546ecb-0891-4133-8ad4-d84cbc5e6a38), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:01.463335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f3acd63b-e4c3-4525-8e7b-3ec41bed812e admin admin] Security group rule updated ['b8458589-3fcc-4e90-a581-3edad5cbc25f'] Sep 27 04:21:01.473030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c05,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=292000000,duration_sec=551,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:01.473884 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:01.476079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:269 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.024 Sep 27 04:21:01.854656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5c690ed0-3afb-4fce-8f9a-1e8f9fd311e1 admin admin] Resource Port deleted: 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:01.855247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5c690ed0-3afb-4fce-8f9a-1e8f9fd311e1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (5c3fe5c2-e2df-4f03-bd8f-40af037c4b87), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:03.184547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9df06dda-d38b-4375-bf64-06df0429274e admin admin] Resource Subnet deleted: 506c094e-adb2-476c-8a72-6b2e0b04ffd8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:03.185845 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9df06dda-d38b-4375-bf64-06df0429274e admin admin] Publish callbacks [] for Subnet (506c094e-adb2-476c-8a72-6b2e0b04ffd8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:03.454571 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:270 started Sep 27 04:21:03.473377 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c07,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=284000000,duration_sec=553,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:03.474306 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:03.476079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:270 - starting polling. Elapsed:0.022 Sep 27 04:21:03.480364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:03.492155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-5c3fe5c2-e2, col_values=(('tag', 4095),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:03.533915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c09,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:03.534691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'] Sep 27 04:21:03.536911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:03.613277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[87530515-2efa-4ec0-8cbd-c1b97d25ed89]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:03.616850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:270 - port information retrieved. Elapsed:0.164 Sep 27 04:21:03.617579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:270 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.165 Sep 27 04:21:03.728394 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["55a69478-0318-46fc-91ab-b23c817eb161","delete","qr-5c3fe5c2-e2",10,["map",[["attached-mac","fa:16:3e:ad:cb:5d"],["iface-id","5c3fe5c2-e2df-4f03-bd8f-40af037c4b87"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:03.771676 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a285649b-8068-4ded-83cd-826db521645b admin admin] Resource Port deleted: 0013e2cc-d36e-4a05-a5c8-47024496dd16 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:03.772229 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a285649b-8068-4ded-83cd-826db521645b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (0013e2cc-d36e-4a05-a5c8-47024496dd16), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:03.871102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:03Z,description='Default security group',id=59ce652e-eed2-4eea-b3e5-75da5ce91b9b,is_default=True,name='default',project_id='8d46e7923d634ee8afcb6f24a2fb02e0',revision_number=1,rules=[SecurityGroupRule(0c105eea-6f54-406a-ac1a-aca62de64289),SecurityGroupRule(7f324053-76f1-4fbb-8792-0a6d256e7fb1),SecurityGroupRule(9fc066a4-85a5-451c-89c2-7355e99b7aa2),SecurityGroupRule(fbd53820-674e-4162-b0f6-68e7b6e6aafc)],shared=False,stateful=True,updated_at=2022-09-27T04:21:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:03.871486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (59ce652e-eed2-4eea-b3e5-75da5ce91b9b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:03.872660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:03Z,description=,direction='egress',ethertype='IPv4',id=0c105eea-6f54-406a-ac1a-aca62de64289,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d46e7923d634ee8afcb6f24a2fb02e0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=59ce652e-eed2-4eea-b3e5-75da5ce91b9b,updated_at=2022-09-27T04:21:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:03.873309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0c105eea-6f54-406a-ac1a-aca62de64289), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:03.873820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Security group rule updated ['59ce652e-eed2-4eea-b3e5-75da5ce91b9b'] Sep 27 04:21:03.874793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:03Z,description=,direction='ingress',ethertype='IPv4',id=7f324053-76f1-4fbb-8792-0a6d256e7fb1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d46e7923d634ee8afcb6f24a2fb02e0',protocol=,remote_address_group_id=,remote_group_id=59ce652e-eed2-4eea-b3e5-75da5ce91b9b,remote_ip_prefix=,revision_number=0,security_group_id=59ce652e-eed2-4eea-b3e5-75da5ce91b9b,updated_at=2022-09-27T04:21:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:03.876067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7f324053-76f1-4fbb-8792-0a6d256e7fb1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:03.877380 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Security group rule updated ['59ce652e-eed2-4eea-b3e5-75da5ce91b9b'] Sep 27 04:21:03.879471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:03Z,description=,direction='ingress',ethertype='IPv6',id=9fc066a4-85a5-451c-89c2-7355e99b7aa2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d46e7923d634ee8afcb6f24a2fb02e0',protocol=,remote_address_group_id=,remote_group_id=59ce652e-eed2-4eea-b3e5-75da5ce91b9b,remote_ip_prefix=,revision_number=0,security_group_id=59ce652e-eed2-4eea-b3e5-75da5ce91b9b,updated_at=2022-09-27T04:21:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:03.881315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9fc066a4-85a5-451c-89c2-7355e99b7aa2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:03.882335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Security group rule updated ['59ce652e-eed2-4eea-b3e5-75da5ce91b9b'] Sep 27 04:21:03.889011 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:03Z,description=,direction='egress',ethertype='IPv6',id=fbd53820-674e-4162-b0f6-68e7b6e6aafc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d46e7923d634ee8afcb6f24a2fb02e0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=59ce652e-eed2-4eea-b3e5-75da5ce91b9b,updated_at=2022-09-27T04:21:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:03.890205 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (fbd53820-674e-4162-b0f6-68e7b6e6aafc), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:03.890559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ed098ad7-0823-4f57-ba55-de7c220d62dc admin admin] Security group rule updated ['59ce652e-eed2-4eea-b3e5-75da5ce91b9b'] Sep 27 04:21:04.145010 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-333501c5-c2b7-4c37-b0d7-1f49fcf707b3 admin admin] Resource Network deleted: 1afc1755-434f-4422-8cf4-6b447aed4322 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:04.145516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-333501c5-c2b7-4c37-b0d7-1f49fcf707b3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (1afc1755-434f-4422-8cf4-6b447aed4322), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:04.281839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Resource SecurityGroup deleted: 59ce652e-eed2-4eea-b3e5-75da5ce91b9b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:04.283174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (59ce652e-eed2-4eea-b3e5-75da5ce91b9b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:04.283985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('59ce652e-eed2-4eea-b3e5-75da5ce91b9b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:04.301893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a2b6ce76-bb0e-4e03-812e-17195ec414f3","delete","qg-0013e2cc-d3",11,["map",[["attached-mac","fa:16:3e:b5:4b:b7"],["iface-id","0013e2cc-d36e-4a05-a5c8-47024496dd16"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:04.310633 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('59ce652e-eed2-4eea-b3e5-75da5ce91b9b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:04.312388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Resource SecurityGroupRule deleted: 0c105eea-6f54-406a-ac1a-aca62de64289 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:04.314570 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0c105eea-6f54-406a-ac1a-aca62de64289), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:04.315319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Security group rule updated ['59ce652e-eed2-4eea-b3e5-75da5ce91b9b'] Sep 27 04:21:04.318245 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Resource SecurityGroupRule deleted: 7f324053-76f1-4fbb-8792-0a6d256e7fb1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:04.318841 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7f324053-76f1-4fbb-8792-0a6d256e7fb1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:04.319694 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Security group rule updated ['59ce652e-eed2-4eea-b3e5-75da5ce91b9b'] Sep 27 04:21:04.322476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Resource SecurityGroupRule deleted: 9fc066a4-85a5-451c-89c2-7355e99b7aa2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:04.323201 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9fc066a4-85a5-451c-89c2-7355e99b7aa2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:04.323957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Security group rule updated ['59ce652e-eed2-4eea-b3e5-75da5ce91b9b'] Sep 27 04:21:04.325284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Resource SecurityGroupRule deleted: fbd53820-674e-4162-b0f6-68e7b6e6aafc {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:04.325970 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (fbd53820-674e-4162-b0f6-68e7b6e6aafc), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:04.326896 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8f961a7b-96a0-4dac-ab67-3637f90e7cee admin admin] Security group rule updated ['59ce652e-eed2-4eea-b3e5-75da5ce91b9b'] Sep 27 04:21:04.501954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c62129fe-2587-4a90-b119-2b01eb6b89fe admin admin] Resource Subnet deleted: ef556055-3d79-4e00-91ba-4215c47f3d3a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:04.502868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c62129fe-2587-4a90-b119-2b01eb6b89fe admin admin] Publish callbacks [] for Subnet (ef556055-3d79-4e00-91ba-4215c47f3d3a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:04.519776 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4683e126-409e-4764-b8be-bdfd81120c96 admin admin] Resource Subnet deleted: bac9f75d-135d-42ac-9cad-3529337be15c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:04.529057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4683e126-409e-4764-b8be-bdfd81120c96 admin admin] Publish callbacks [] for Subnet (bac9f75d-135d-42ac-9cad-3529337be15c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:04.723569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["150f4339-63d5-4c56-b6d7-87c730631b53","delete","tap2d5f14d8-97",7,["map",[["attached-mac","fa:16:3e:c7:03:4f"],["iface-id","2d5f14d8-97ae-45cd-98a4-2634bc19c645"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:04.993660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ce389709-55e4-463f-abbb-3c2169261981 admin admin] Resource Port deleted: 2d5f14d8-97ae-45cd-98a4-2634bc19c645 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:04.994286 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ce389709-55e4-463f-abbb-3c2169261981 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (2d5f14d8-97ae-45cd-98a4-2634bc19c645), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:05.074856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-652a944f-8b97-4a78-bd9f-d09cdfba66b7 admin admin] Resource Network deleted: 2cfbbe7d-ad34-4af4-8505-f9b7056fc24b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:05.075769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-652a944f-8b97-4a78-bd9f-d09cdfba66b7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (2cfbbe7d-ad34-4af4-8505-f9b7056fc24b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:05.260793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b2d73931-9774-4f7c-8aad-4266bf0fdbf1 None None] Resource Port deleted: 2d5f14d8-97ae-45cd-98a4-2634bc19c645 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:05.261127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b2d73931-9774-4f7c-8aad-4266bf0fdbf1 None None] Skipped duplicate delete event for 2d5f14d8-97ae-45cd-98a4-2634bc19c645 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 27 04:21:05.454512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:271 started Sep 27 04:21:05.457440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c0b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=281000000,duration_sec=555,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:05.458158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:05.458660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:271 - starting polling. Elapsed:0.004 Sep 27 04:21:05.462340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:05.471065 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c0d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:05.491083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c0f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:05.493573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ce389709-55e4-463f-abbb-3c2169261981 admin admin] Resource Network deleted: 90468030-e15f-4d68-bea3-d020393e070f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:05.496496 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ce389709-55e4-463f-abbb-3c2169261981 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (90468030-e15f-4d68-bea3-d020393e070f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:05.505949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c11,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:05.506410 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:271 - port information retrieved. Elapsed:0.052 Sep 27 04:21:05.506879 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:05.507736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:271 - agent port security group processed in 0.000 Sep 27 04:21:05.509583 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:21:05.510081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'} Sep 27 04:21:05.510661 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 5c3fe5c2-e2df-4f03-bd8f-40af037c4b87 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:21:05.511542 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 8 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:05.565655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f23b43d-7e13-4140-9edc-b0bf8d465250]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:05.566333 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'2d5f14d8-97ae-45cd-98a4-2634bc19c645', '0013e2cc-d36e-4a05-a5c8-47024496dd16', '5c3fe5c2-e2df-4f03-bd8f-40af037c4b87'} removed Sep 27 04:21:05.680744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:21:05.681701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 5 from net-id = 90468030-e15f-4d68-bea3-d020393e070f, seg-id = 141 Sep 27 04:21:05.692174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32ea7,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:05.696194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc22c13,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4237}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:05.697586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:21:05.698282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:271 - treat_devices_removed completed in 0.188 Sep 27 04:21:05.698651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:271 - ports processed. Elapsed:0.244 Sep 27 04:21:05.699734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:271 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.245 Sep 27 04:21:05.733397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Resource SecurityGroup deleted: 8397793a-81e7-4a0a-a47e-96ee6218b77c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:05.733837 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (8397793a-81e7-4a0a-a47e-96ee6218b77c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:05.734493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8397793a-81e7-4a0a-a47e-96ee6218b77c',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:05.755125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8397793a-81e7-4a0a-a47e-96ee6218b77c',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:05.755599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Resource SecurityGroupRule deleted: 2bfc6479-c7fe-4d6d-b3e1-5ccb0d0546f5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:05.755974 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2bfc6479-c7fe-4d6d-b3e1-5ccb0d0546f5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:05.756319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Security group rule updated ['8397793a-81e7-4a0a-a47e-96ee6218b77c'] Sep 27 04:21:05.756745 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Resource SecurityGroupRule deleted: 2e2e1e2d-e3f5-4395-8458-997caca95340 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:05.757092 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2e2e1e2d-e3f5-4395-8458-997caca95340), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:05.758899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Security group rule updated ['8397793a-81e7-4a0a-a47e-96ee6218b77c'] Sep 27 04:21:05.759165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Resource SecurityGroupRule deleted: a958755a-f2ed-461c-a4a9-88517ac8324c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:05.759533 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a958755a-f2ed-461c-a4a9-88517ac8324c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:05.759864 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Security group rule updated ['8397793a-81e7-4a0a-a47e-96ee6218b77c'] Sep 27 04:21:05.760245 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Resource SecurityGroupRule deleted: c8e01598-bac6-4d87-a131-b597a1d772f5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:05.760594 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c8e01598-bac6-4d87-a131-b597a1d772f5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:05.760920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c288a0f4-fc40-4f4b-a870-b09b86c2b49e admin admin] Security group rule updated ['8397793a-81e7-4a0a-a47e-96ee6218b77c'] Sep 27 04:21:06.066997 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Resource SecurityGroup deleted: 6292e5d4-a4a9-48a7-955f-6a9e34544572 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:06.067578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (6292e5d4-a4a9-48a7-955f-6a9e34544572), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:06.068198 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6292e5d4-a4a9-48a7-955f-6a9e34544572',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:06.111035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6292e5d4-a4a9-48a7-955f-6a9e34544572',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:06.111619 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Resource SecurityGroupRule deleted: 14d50b75-ed41-4925-b5a5-00a15cd4f0bd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:06.112662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (14d50b75-ed41-4925-b5a5-00a15cd4f0bd), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:06.112948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Security group rule updated ['6292e5d4-a4a9-48a7-955f-6a9e34544572'] Sep 27 04:21:06.113351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Resource SecurityGroupRule deleted: 23d5db83-309b-4b0d-80ce-9c3a62b15224 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:06.113840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (23d5db83-309b-4b0d-80ce-9c3a62b15224), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:06.114186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Security group rule updated ['6292e5d4-a4a9-48a7-955f-6a9e34544572'] Sep 27 04:21:06.114596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Resource SecurityGroupRule deleted: 434b229b-622f-4b47-95c3-23f1c62ecef6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:06.114963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (434b229b-622f-4b47-95c3-23f1c62ecef6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:06.115304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Security group rule updated ['6292e5d4-a4a9-48a7-955f-6a9e34544572'] Sep 27 04:21:06.115832 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Resource SecurityGroupRule deleted: f4fc6e30-83b9-4013-8fee-6b8714f4faf1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:06.116218 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f4fc6e30-83b9-4013-8fee-6b8714f4faf1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:06.116587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c19ed172-fdc3-45c3-b211-28bbe805cb4f admin admin] Security group rule updated ['6292e5d4-a4a9-48a7-955f-6a9e34544572'] Sep 27 04:21:06.493159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Resource SecurityGroup deleted: a7debd45-d1f0-4f73-8634-2d2954673c0a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:06.493729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (a7debd45-d1f0-4f73-8634-2d2954673c0a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:06.494135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a7debd45-d1f0-4f73-8634-2d2954673c0a',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:06.510545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a7debd45-d1f0-4f73-8634-2d2954673c0a',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:06.511577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Resource SecurityGroupRule deleted: 2d365674-17e3-4371-b201-c5c1f6a8a5cb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:06.512461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2d365674-17e3-4371-b201-c5c1f6a8a5cb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:06.513083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Security group rule updated ['a7debd45-d1f0-4f73-8634-2d2954673c0a'] Sep 27 04:21:06.513661 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Resource SecurityGroupRule deleted: 36f83fec-c688-4cce-8851-4bb502c5f963 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:06.514484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (36f83fec-c688-4cce-8851-4bb502c5f963), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:06.515159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Security group rule updated ['a7debd45-d1f0-4f73-8634-2d2954673c0a'] Sep 27 04:21:06.516041 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Resource SecurityGroupRule deleted: 63f4b3c2-56e0-4283-a62a-448b78dc2e94 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:06.516536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (63f4b3c2-56e0-4283-a62a-448b78dc2e94), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:06.517192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Security group rule updated ['a7debd45-d1f0-4f73-8634-2d2954673c0a'] Sep 27 04:21:06.518066 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Resource SecurityGroupRule deleted: a5c34e7f-381f-43d1-afd9-447e8860fdc6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:06.519063 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a5c34e7f-381f-43d1-afd9-447e8860fdc6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:06.519537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-71f7055f-e6ca-4dd1-8581-2d816bdd53eb admin admin] Security group rule updated ['a7debd45-d1f0-4f73-8634-2d2954673c0a'] Sep 27 04:21:07.247209 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:07Z,description='Default security group',id=dad0251b-74f4-4f16-a784-be5aec073ee7,is_default=True,name='default',project_id='c25f11f92d4e4fd8965fe630ad77f3c3',revision_number=1,rules=[SecurityGroupRule(5cee919a-b45e-423e-b3b7-a2e3c93ea526),SecurityGroupRule(962bb38e-efcb-4e6f-bba3-006532dc756d),SecurityGroupRule(cdf0ab2f-dc59-4af1-b644-8019f66741be),SecurityGroupRule(fd1609e1-09fb-4396-9c49-f474c7725a44)],shared=False,stateful=True,updated_at=2022-09-27T04:21:07Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:07.247801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (dad0251b-74f4-4f16-a784-be5aec073ee7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:07.248580 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:07Z,description=,direction='egress',ethertype='IPv6',id=5cee919a-b45e-423e-b3b7-a2e3c93ea526,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dad0251b-74f4-4f16-a784-be5aec073ee7,updated_at=2022-09-27T04:21:07Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:07.249172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5cee919a-b45e-423e-b3b7-a2e3c93ea526), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:07.249512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Security group rule updated ['dad0251b-74f4-4f16-a784-be5aec073ee7'] Sep 27 04:21:07.250327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:07Z,description=,direction='egress',ethertype='IPv4',id=962bb38e-efcb-4e6f-bba3-006532dc756d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dad0251b-74f4-4f16-a784-be5aec073ee7,updated_at=2022-09-27T04:21:07Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:07.250906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (962bb38e-efcb-4e6f-bba3-006532dc756d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:07.251291 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Security group rule updated ['dad0251b-74f4-4f16-a784-be5aec073ee7'] Sep 27 04:21:07.252982 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:07Z,description=,direction='ingress',ethertype='IPv6',id=cdf0ab2f-dc59-4af1-b644-8019f66741be,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',protocol=,remote_address_group_id=,remote_group_id=dad0251b-74f4-4f16-a784-be5aec073ee7,remote_ip_prefix=,revision_number=0,security_group_id=dad0251b-74f4-4f16-a784-be5aec073ee7,updated_at=2022-09-27T04:21:07Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:07.253587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cdf0ab2f-dc59-4af1-b644-8019f66741be), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:07.254228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Security group rule updated ['dad0251b-74f4-4f16-a784-be5aec073ee7'] Sep 27 04:21:07.269202 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:07Z,description=,direction='ingress',ethertype='IPv4',id=fd1609e1-09fb-4396-9c49-f474c7725a44,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',protocol=,remote_address_group_id=,remote_group_id=dad0251b-74f4-4f16-a784-be5aec073ee7,remote_ip_prefix=,revision_number=0,security_group_id=dad0251b-74f4-4f16-a784-be5aec073ee7,updated_at=2022-09-27T04:21:07Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:07.269619 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (fd1609e1-09fb-4396-9c49-f474c7725a44), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:07.269997 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Security group rule updated ['dad0251b-74f4-4f16-a784-be5aec073ee7'] Sep 27 04:21:07.420784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:21:07Z,description='',dns_domain=None,id=3b03541e-a362-4f1f-858b-b7051275090d,mtu=1500,name='tempest-ServerRescueNegativeTestJSON-140140347-network',project_id='c25f11f92d4e4fd8965fe630ad77f3c3',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(3b03541e-a362-4f1f-858b-b7051275090d),segments=[NetworkSegment(4790901f-5695-41bc-be7f-0e3d4d5126bd)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:21:07Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:07.421173 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (3b03541e-a362-4f1f-858b-b7051275090d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:07.456007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:272 started Sep 27 04:21:07.459756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c15,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=283000000,duration_sec=557,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:07.461488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:07.463020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:272 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-85cc9d71-4e5e-4644-a2d2-d8f8a177b10e admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3b03541e-a362-4f1f-858b-b7051275090d with segmentation id not found. Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:21:07.505018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:21:07.506418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:21:07.506418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:21:07.506418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:21:07.506418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3b03541e-a362-4f1f-858b-b7051275090d with segmentation id not found. Sep 27 04:21:07.506418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:21:07.731729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-caa99cd0-5892-4b9e-adb7-d5c199818423 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(0e867463-538c-434a-ac1e-b88337339818)],cidr=172.20.0.0/28,created_at=2022-09-27T04:21:07Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=3d4a66ea-0873-4a30-ab4a-55cd0b629103,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-ServerRescueNegativeTestJSON-140140347-subnet',network_id=3b03541e-a362-4f1f-858b-b7051275090d,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:21:07Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:07.732521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-caa99cd0-5892-4b9e-adb7-d5c199818423 admin admin] Publish callbacks [] for Subnet (3d4a66ea-0873-4a30-ab4a-55cd0b629103), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:08.309452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b4d923b3-1f9c-489c-be4e-665918fd58e2 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:07Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-3b03541e-a362-4f1f-858b-b7051275090d',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3a195ca1-f95a-4b00-b874-500af40a79fd,mac_address=fa:16:3e:d9:ea:ef,name='',network_id=3b03541e-a362-4f1f-858b-b7051275090d,numa_affinity_policy=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3a195ca1-f95a-4b00-b874-500af40a79fd),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:08Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:08.313441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b4d923b3-1f9c-489c-be4e-665918fd58e2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (3a195ca1-f95a-4b00-b874-500af40a79fd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:08.537545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b4d923b3-1f9c-489c-be4e-665918fd58e2 None None] Resource Port 3a195ca1-f95a-4b00-b874-500af40a79fd updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=3a195ca1-f95a-4b00-b874-500af40a79fd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=3a195ca1-f95a-4b00-b874-500af40a79fd,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=3a195ca1-f95a-4b00-b874-500af40a79fd,segment=NetworkSegment(4790901f-5695-41bc-be7f-0e3d4d5126bd),segment_id=4790901f-5695-41bc-be7f-0e3d4d5126bd)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:08.538289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b4d923b3-1f9c-489c-be4e-665918fd58e2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (3a195ca1-f95a-4b00-b874-500af40a79fd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:08.629604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ae66b86b-c623-4796-8585-ea223edcf876","insert","tap3a195ca1-f9",["set",[]],["map",[["attached-mac","fa:16:3e:d9:ea:ef"],["iface-id","3a195ca1-f95a-4b00-b874-500af40a79fd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:08.653379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ae66b86b-c623-4796-8585-ea223edcf876","old",null,["set",[]],null],["","new","tap3a195ca1-f9",15,["map",[["attached-mac","fa:16:3e:d9:ea:ef"],["iface-id","3a195ca1-f95a-4b00-b874-500af40a79fd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:08.811923 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-99bff98e-7fa8-47e2-a4f9-6c917db0b370 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:08Z,data_plane_status=None,description='',device_id='86f1d0b9-3657-437b-ae62-2e9ed22d6485',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b4d8a087-7ecc-4c15-a09e-d89340dc105d,mac_address=fa:16:3e:da:63:e0,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b4d8a087-7ecc-4c15-a09e-d89340dc105d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:08Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:08.812320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-99bff98e-7fa8-47e2-a4f9-6c917db0b370 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b4d8a087-7ecc-4c15-a09e-d89340dc105d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:09.458139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:273 started Sep 27 04:21:09.460591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c17,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=285000000,duration_sec=559,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:09.461207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:09.461682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:273 - starting polling. Elapsed:0.004 Sep 27 04:21:09.463596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:09.466174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:273 - port information retrieved. Elapsed:0.008 Sep 27 04:21:09.466674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '3a195ca1-f95a-4b00-b874-500af40a79fd', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'3a195ca1-f95a-4b00-b874-500af40a79fd'}, 'removed': set(), 'updated': {'3a195ca1-f95a-4b00-b874-500af40a79fd'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:09.467484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '3a195ca1-f95a-4b00-b874-500af40a79fd', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-3b03541e-a362-4f1f-858b-b7051275090d', 'network_id': '3b03541e-a362-4f1f-858b-b7051275090d', 'port_id': '3a195ca1-f95a-4b00-b874-500af40a79fd', 'mac_address': 'fa:16:3e:d9:ea:ef', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 132, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d4a66ea-0873-4a30-ab4a-55cd0b629103', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:09.470648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 3a195ca1-f95a-4b00-b874-500af40a79fd {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:09.470989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 3a195ca1-f95a-4b00-b874-500af40a79fd updated. Details: {'device': '3a195ca1-f95a-4b00-b874-500af40a79fd', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-3b03541e-a362-4f1f-858b-b7051275090d', 'network_id': '3b03541e-a362-4f1f-858b-b7051275090d', 'port_id': '3a195ca1-f95a-4b00-b874-500af40a79fd', 'mac_address': 'fa:16:3e:d9:ea:ef', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 132, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d4a66ea-0873-4a30-ab4a-55cd0b629103', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:21:09.471322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 7 as local vlan for net-id=3b03541e-a362-4f1f-858b-b7051275090d, seg-id=132 Sep 27 04:21:09.476692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32ea9,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4228), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:09.479424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22c19,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4103)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4228}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:09.480700 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3a195ca1-f9, col_values=(('tag', 7),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:09.481323 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap3a195ca1-f9, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:09.481801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap3a195ca1-f9, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:09.496604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3a195ca1-f9, col_values=(('other_config', {'net_uuid': '3b03541e-a362-4f1f-858b-b7051275090d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '132'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:09.507229 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c1b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:09.507611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:273 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 11 devices currently available. Time elapsed: 0.040 Sep 27 04:21:09.507988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:21:09.508331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'3a195ca1-f95a-4b00-b874-500af40a79fd'} Sep 27 04:21:09.509666 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:09.510057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:09.516422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:09.560748 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[65426a5e-1417-4c22-9435-9dee66352438]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:09.561909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:273 - agent port security group processed in 0.094 Sep 27 04:21:09.562635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 3a195ca1-f95a-4b00-b874-500af40a79fd to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:10.206473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['3a195ca1-f95a-4b00-b874-500af40a79fd'] and devices down [] completed. Sep 27 04:21:10.206824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:273 - ports processed. Elapsed:0.749 Sep 27 04:21:10.207549 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:273 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.749 Sep 27 04:21:10.215894 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a58b0903-7c5f-424e-9242-2f2cd805e053 None None] Resource Port 3a195ca1-f95a-4b00-b874-500af40a79fd updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:10.216349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a58b0903-7c5f-424e-9242-2f2cd805e053 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (3a195ca1-f95a-4b00-b874-500af40a79fd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:10.335667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-31e29859-3d56-4e61-b24b-2759dbe1eb73 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:09Z,data_plane_status=None,description='',device_id='86f1d0b9-3657-437b-ae62-2e9ed22d6485',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1cb6df63-5dd5-460b-86da-ef0071c67709,mac_address=fa:16:3e:88:33:c3,name='',network_id=3b03541e-a362-4f1f-858b-b7051275090d,numa_affinity_policy=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1cb6df63-5dd5-460b-86da-ef0071c67709),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:10.336284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-31e29859-3d56-4e61-b24b-2759dbe1eb73 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (1cb6df63-5dd5-460b-86da-ef0071c67709), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:10.750179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-31e29859-3d56-4e61-b24b-2759dbe1eb73 admin admin] Received resource Port update without any changes: 1cb6df63-5dd5-460b-86da-ef0071c67709 {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:21:10.754255 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e31835f7-f4b4-4ad8-8f28-157512e1d22d None None] Resource Port b4d8a087-7ecc-4c15-a09e-d89340dc105d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=b4d8a087-7ecc-4c15-a09e-d89340dc105d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=b4d8a087-7ecc-4c15-a09e-d89340dc105d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:10.754727 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e31835f7-f4b4-4ad8-8f28-157512e1d22d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b4d8a087-7ecc-4c15-a09e-d89340dc105d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:10.946774 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e31835f7-f4b4-4ad8-8f28-157512e1d22d None None] Resource Port b4d8a087-7ecc-4c15-a09e-d89340dc105d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=b4d8a087-7ecc-4c15-a09e-d89340dc105d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=b4d8a087-7ecc-4c15-a09e-d89340dc105d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=b4d8a087-7ecc-4c15-a09e-d89340dc105d,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:10.947488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e31835f7-f4b4-4ad8-8f28-157512e1d22d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b4d8a087-7ecc-4c15-a09e-d89340dc105d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:11.408765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a209cd58-a0d6-497a-9eb9-b0fb9680afa3","insert","qr-1cb6df63-5d",["set",[]],["map",[["attached-mac","fa:16:3e:88:33:c3"],["iface-id","1cb6df63-5dd5-460b-86da-ef0071c67709"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:11.429648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a209cd58-a0d6-497a-9eb9-b0fb9680afa3","old",null,["set",[]],null],["","new","qr-1cb6df63-5d",16,["map",[["attached-mac","fa:16:3e:88:33:c3"],["iface-id","1cb6df63-5dd5-460b-86da-ef0071c67709"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:11.458856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:274 started Sep 27 04:21:11.461210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c1d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=285000000,duration_sec=561,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:11.461895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:11.462362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:274 - starting polling. Elapsed:0.004 Sep 27 04:21:11.464322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:11.466751 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:274 - port information retrieved. Elapsed:0.008 Sep 27 04:21:11.467079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '3a195ca1-f95a-4b00-b874-500af40a79fd', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'1cb6df63-5dd5-460b-86da-ef0071c67709'}, 'removed': set(), 'updated': {'3a195ca1-f95a-4b00-b874-500af40a79fd', '1cb6df63-5dd5-460b-86da-ef0071c67709'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:11.467660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '3a195ca1-f95a-4b00-b874-500af40a79fd', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-3b03541e-a362-4f1f-858b-b7051275090d', 'network_id': '3b03541e-a362-4f1f-858b-b7051275090d', 'port_id': '3a195ca1-f95a-4b00-b874-500af40a79fd', 'mac_address': 'fa:16:3e:d9:ea:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 132, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d4a66ea-0873-4a30-ab4a-55cd0b629103', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:11.468260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:09Z,data_plane_status=None,description='',device_id='86f1d0b9-3657-437b-ae62-2e9ed22d6485',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1cb6df63-5dd5-460b-86da-ef0071c67709,mac_address=fa:16:3e:88:33:c3,name='',network_id=3b03541e-a362-4f1f-858b-b7051275090d,numa_affinity_policy=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(1cb6df63-5dd5-460b-86da-ef0071c67709),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:10Z) is not bound. Sep 27 04:21:11.471340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 3a195ca1-f95a-4b00-b874-500af40a79fd {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:11.471719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 3a195ca1-f95a-4b00-b874-500af40a79fd updated. Details: {'device': '3a195ca1-f95a-4b00-b874-500af40a79fd', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-3b03541e-a362-4f1f-858b-b7051275090d', 'network_id': '3b03541e-a362-4f1f-858b-b7051275090d', 'port_id': '3a195ca1-f95a-4b00-b874-500af40a79fd', 'mac_address': 'fa:16:3e:d9:ea:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 132, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d4a66ea-0873-4a30-ab4a-55cd0b629103', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Sep 27 04:21:11.472821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3a195ca1-f9, col_values=(('tag', 7),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:11.473315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap3a195ca1-f9, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:11.473772 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap3a195ca1-f9, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:11.474663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:11.475878 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3a195ca1-f9, col_values=(('other_config', {'net_uuid': '3b03541e-a362-4f1f-858b-b7051275090d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '132', 'tag': '7'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:11.479692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:11.494039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c1f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:11.494270 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 1cb6df63-5dd5-460b-86da-ef0071c67709 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:11.494620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device 1cb6df63-5dd5-460b-86da-ef0071c67709 not defined on plugin or binding failed Sep 27 04:21:11.495163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:274 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.028 Sep 27 04:21:11.495516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:21:11.495815 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'1cb6df63-5dd5-460b-86da-ef0071c67709'} Sep 27 04:21:11.496767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:11.497048 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:11.501916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:21:11.502231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:21:11.503625 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:11.503915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:11.507611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:11.552777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[affa6100-2a32-4f66-b502-87eb0a488705]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:11.558178 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:274 - agent port security group processed in 0.091 Sep 27 04:21:11.559945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 3a195ca1-f95a-4b00-b874-500af40a79fd to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:11.721386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['3a195ca1-f95a-4b00-b874-500af40a79fd'] and devices down [] completed. Sep 27 04:21:11.721964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:274 - ports processed. Elapsed:0.263 Sep 27 04:21:11.722336 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:274 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.264 Sep 27 04:21:12.015679 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e2e4160b-93b4-4695-a6e4-bd56febc524d","insert","qg-b4d8a087-7e",["set",[]],["map",[["attached-mac","fa:16:3e:da:63:e0"],["iface-id","b4d8a087-7ecc-4c15-a09e-d89340dc105d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:12.032561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e2e4160b-93b4-4695-a6e4-bd56febc524d","old",null,["set",[]],null],["","new","qg-b4d8a087-7e",17,["map",[["attached-mac","fa:16:3e:da:63:e0"],["iface-id","b4d8a087-7ecc-4c15-a09e-d89340dc105d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:12.821450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:12Z,description='Default security group',id=af8d2238-da0b-4e4c-b128-81a2b2b7e602,is_default=True,name='default',project_id='ffc59ae7bbce4d56aace17cdd05ecceb',revision_number=1,rules=[SecurityGroupRule(119c1fe0-6ead-41da-a674-898fb857d421),SecurityGroupRule(195d51cf-c03b-4f31-8093-f3ae1c0ae082),SecurityGroupRule(4d74c653-d2a4-4d4a-a931-73441e6f356f),SecurityGroupRule(5cffcad5-f76b-43ad-855b-3e6705711c9d)],shared=False,stateful=True,updated_at=2022-09-27T04:21:12Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:12.822173 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (af8d2238-da0b-4e4c-b128-81a2b2b7e602), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:12.823085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:12Z,description=,direction='egress',ethertype='IPv6',id=119c1fe0-6ead-41da-a674-898fb857d421,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ffc59ae7bbce4d56aace17cdd05ecceb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=af8d2238-da0b-4e4c-b128-81a2b2b7e602,updated_at=2022-09-27T04:21:12Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:12.823704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (119c1fe0-6ead-41da-a674-898fb857d421), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:12.824200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Security group rule updated ['af8d2238-da0b-4e4c-b128-81a2b2b7e602'] Sep 27 04:21:12.825382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:12Z,description=,direction='ingress',ethertype='IPv4',id=195d51cf-c03b-4f31-8093-f3ae1c0ae082,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ffc59ae7bbce4d56aace17cdd05ecceb',protocol=,remote_address_group_id=,remote_group_id=af8d2238-da0b-4e4c-b128-81a2b2b7e602,remote_ip_prefix=,revision_number=0,security_group_id=af8d2238-da0b-4e4c-b128-81a2b2b7e602,updated_at=2022-09-27T04:21:12Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:12.826499 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (195d51cf-c03b-4f31-8093-f3ae1c0ae082), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:12.827929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Security group rule updated ['af8d2238-da0b-4e4c-b128-81a2b2b7e602'] Sep 27 04:21:12.829039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:12Z,description=,direction='ingress',ethertype='IPv6',id=4d74c653-d2a4-4d4a-a931-73441e6f356f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ffc59ae7bbce4d56aace17cdd05ecceb',protocol=,remote_address_group_id=,remote_group_id=af8d2238-da0b-4e4c-b128-81a2b2b7e602,remote_ip_prefix=,revision_number=0,security_group_id=af8d2238-da0b-4e4c-b128-81a2b2b7e602,updated_at=2022-09-27T04:21:12Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:12.829564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4d74c653-d2a4-4d4a-a931-73441e6f356f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:12.830354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Security group rule updated ['af8d2238-da0b-4e4c-b128-81a2b2b7e602'] Sep 27 04:21:12.831398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:12Z,description=,direction='egress',ethertype='IPv4',id=5cffcad5-f76b-43ad-855b-3e6705711c9d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ffc59ae7bbce4d56aace17cdd05ecceb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=af8d2238-da0b-4e4c-b128-81a2b2b7e602,updated_at=2022-09-27T04:21:12Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:12.832023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5cffcad5-f76b-43ad-855b-3e6705711c9d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:12.832572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4322d343-fb9b-4cd1-8550-7eeecb2f135f admin admin] Security group rule updated ['af8d2238-da0b-4e4c-b128-81a2b2b7e602'] Sep 27 04:21:12.979549 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Resource SecurityGroup deleted: af8d2238-da0b-4e4c-b128-81a2b2b7e602 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:12.979929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (af8d2238-da0b-4e4c-b128-81a2b2b7e602), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:12.980823 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('af8d2238-da0b-4e4c-b128-81a2b2b7e602',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:13.000751 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('af8d2238-da0b-4e4c-b128-81a2b2b7e602',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:13.001407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Resource SecurityGroupRule deleted: 119c1fe0-6ead-41da-a674-898fb857d421 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:13.001795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (119c1fe0-6ead-41da-a674-898fb857d421), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.002287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Security group rule updated ['af8d2238-da0b-4e4c-b128-81a2b2b7e602'] Sep 27 04:21:13.002687 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Resource SecurityGroupRule deleted: 195d51cf-c03b-4f31-8093-f3ae1c0ae082 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:13.003048 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (195d51cf-c03b-4f31-8093-f3ae1c0ae082), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.003352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Security group rule updated ['af8d2238-da0b-4e4c-b128-81a2b2b7e602'] Sep 27 04:21:13.003808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Resource SecurityGroupRule deleted: 4d74c653-d2a4-4d4a-a931-73441e6f356f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:13.004155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4d74c653-d2a4-4d4a-a931-73441e6f356f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.004472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Security group rule updated ['af8d2238-da0b-4e4c-b128-81a2b2b7e602'] Sep 27 04:21:13.004840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Resource SecurityGroupRule deleted: 5cffcad5-f76b-43ad-855b-3e6705711c9d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:13.005241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5cffcad5-f76b-43ad-855b-3e6705711c9d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.005579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0918234a-e96c-4f2a-8928-aaa22439bb2d admin admin] Security group rule updated ['af8d2238-da0b-4e4c-b128-81a2b2b7e602'] Sep 27 04:21:13.455753 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:13Z,description='Default security group',id=93af7427-83b3-46fc-bb49-926a7c572686,is_default=True,name='default',project_id='91f011314af940eda4e4fdb66a3c8226',revision_number=1,rules=[SecurityGroupRule(5a6962c3-ed63-436e-afc8-2c859ea62276),SecurityGroupRule(a794ab3f-0b00-48bb-82ba-c6fcc43ae518),SecurityGroupRule(b29e1232-1765-42d4-a6de-fd650b20a130),SecurityGroupRule(da2fc59a-38ba-4c6a-9e95-7530d37c3b04)],shared=False,stateful=True,updated_at=2022-09-27T04:21:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:13.456346 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (93af7427-83b3-46fc-bb49-926a7c572686), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.456741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:13Z,description=,direction='ingress',ethertype='IPv4',id=5a6962c3-ed63-436e-afc8-2c859ea62276,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91f011314af940eda4e4fdb66a3c8226',protocol=,remote_address_group_id=,remote_group_id=93af7427-83b3-46fc-bb49-926a7c572686,remote_ip_prefix=,revision_number=0,security_group_id=93af7427-83b3-46fc-bb49-926a7c572686,updated_at=2022-09-27T04:21:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:13.457100 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5a6962c3-ed63-436e-afc8-2c859ea62276), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.457431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Security group rule updated ['93af7427-83b3-46fc-bb49-926a7c572686'] Sep 27 04:21:13.458136 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:13Z,description=,direction='egress',ethertype='IPv4',id=a794ab3f-0b00-48bb-82ba-c6fcc43ae518,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91f011314af940eda4e4fdb66a3c8226',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=93af7427-83b3-46fc-bb49-926a7c572686,updated_at=2022-09-27T04:21:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:13.458557 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a794ab3f-0b00-48bb-82ba-c6fcc43ae518), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.458830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Security group rule updated ['93af7427-83b3-46fc-bb49-926a7c572686'] Sep 27 04:21:13.459478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:13Z,description=,direction='egress',ethertype='IPv6',id=b29e1232-1765-42d4-a6de-fd650b20a130,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91f011314af940eda4e4fdb66a3c8226',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=93af7427-83b3-46fc-bb49-926a7c572686,updated_at=2022-09-27T04:21:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:13.459824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b29e1232-1765-42d4-a6de-fd650b20a130), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.460147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Security group rule updated ['93af7427-83b3-46fc-bb49-926a7c572686'] Sep 27 04:21:13.460840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:13Z,description=,direction='ingress',ethertype='IPv6',id=da2fc59a-38ba-4c6a-9e95-7530d37c3b04,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91f011314af940eda4e4fdb66a3c8226',protocol=,remote_address_group_id=,remote_group_id=93af7427-83b3-46fc-bb49-926a7c572686,remote_ip_prefix=,revision_number=0,security_group_id=93af7427-83b3-46fc-bb49-926a7c572686,updated_at=2022-09-27T04:21:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:13.461138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (da2fc59a-38ba-4c6a-9e95-7530d37c3b04), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.461461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d55bf2be-30d1-43bb-8958-9a3c197e983f admin admin] Security group rule updated ['93af7427-83b3-46fc-bb49-926a7c572686'] Sep 27 04:21:13.462480 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:275 started Sep 27 04:21:13.464788 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c21,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=289000000,duration_sec=563,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:13.465765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:13.466219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:275 - starting polling. Elapsed:0.004 Sep 27 04:21:13.468405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.471268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:275 - port information retrieved. Elapsed:0.009 Sep 27 04:21:13.471587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '3a195ca1-f95a-4b00-b874-500af40a79fd', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'b4d8a087-7ecc-4c15-a09e-d89340dc105d'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:13.472152 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'device_id': '86f1d0b9-3657-437b-ae62-2e9ed22d6485', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'mac_address': 'fa:16:3e:da:63:e0', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.120'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:13.474640 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: b4d8a087-7ecc-4c15-a09e-d89340dc105d {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:13.475167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b4d8a087-7ecc-4c15-a09e-d89340dc105d updated. Details: {'device': 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'device_id': '86f1d0b9-3657-437b-ae62-2e9ed22d6485', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'mac_address': 'fa:16:3e:da:63:e0', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.120'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:21:13.476125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b4d8a087-7e, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:13.476741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-b4d8a087-7e, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:13.477348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-b4d8a087-7e, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:13.491300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b4d8a087-7e, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:13.502945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c23,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:13.503424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:275 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.031 Sep 27 04:21:13.503850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:21:13.504227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'b4d8a087-7ecc-4c15-a09e-d89340dc105d'} Sep 27 04:21:13.505451 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:13.506110 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:13.509996 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:13.551241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb921cb-a109-484c-8047-a1b9257ebdc5]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:13.551890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:275 - agent port security group processed in 0.080 Sep 27 04:21:13.552660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for b4d8a087-7ecc-4c15-a09e-d89340dc105d to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:13.594423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Resource SecurityGroup deleted: 93af7427-83b3-46fc-bb49-926a7c572686 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:13.594987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (93af7427-83b3-46fc-bb49-926a7c572686), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.595640 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('93af7427-83b3-46fc-bb49-926a7c572686',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:13.632324 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('93af7427-83b3-46fc-bb49-926a7c572686',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:13.633232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Resource SecurityGroupRule deleted: 5a6962c3-ed63-436e-afc8-2c859ea62276 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:13.633915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5a6962c3-ed63-436e-afc8-2c859ea62276), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.634260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Security group rule updated ['93af7427-83b3-46fc-bb49-926a7c572686'] Sep 27 04:21:13.634680 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Resource SecurityGroupRule deleted: a794ab3f-0b00-48bb-82ba-c6fcc43ae518 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:13.635099 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a794ab3f-0b00-48bb-82ba-c6fcc43ae518), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.635424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Security group rule updated ['93af7427-83b3-46fc-bb49-926a7c572686'] Sep 27 04:21:13.635793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Resource SecurityGroupRule deleted: b29e1232-1765-42d4-a6de-fd650b20a130 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:13.636155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b29e1232-1765-42d4-a6de-fd650b20a130), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.636477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Security group rule updated ['93af7427-83b3-46fc-bb49-926a7c572686'] Sep 27 04:21:13.636837 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Resource SecurityGroupRule deleted: da2fc59a-38ba-4c6a-9e95-7530d37c3b04 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:13.637175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (da2fc59a-38ba-4c6a-9e95-7530d37c3b04), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:13.637509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-70fb8910-e118-4cfe-9c25-a1fe3bb45a93 admin admin] Security group rule updated ['93af7427-83b3-46fc-bb49-926a7c572686'] Sep 27 04:21:13.788231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['b4d8a087-7ecc-4c15-a09e-d89340dc105d'] and devices down [] completed. Sep 27 04:21:13.788738 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:275 - ports processed. Elapsed:0.326 Sep 27 04:21:13.789468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:275 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.327 Sep 27 04:21:13.848036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port b4d8a087-7ecc-4c15-a09e-d89340dc105d updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=b4d8a087-7ecc-4c15-a09e-d89340dc105d,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=b4d8a087-7ecc-4c15-a09e-d89340dc105d,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:13.848840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b4d8a087-7ecc-4c15-a09e-d89340dc105d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:14.460112 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-550fbced-74fa-48b0-a4aa-74823f842b6b None None] Resource Port 1cb6df63-5dd5-460b-86da-ef0071c67709 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=1cb6df63-5dd5-460b-86da-ef0071c67709,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=1cb6df63-5dd5-460b-86da-ef0071c67709,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:14.460744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-550fbced-74fa-48b0-a4aa-74823f842b6b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (1cb6df63-5dd5-460b-86da-ef0071c67709), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:14.722298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-550fbced-74fa-48b0-a4aa-74823f842b6b None None] Resource Port 1cb6df63-5dd5-460b-86da-ef0071c67709 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=1cb6df63-5dd5-460b-86da-ef0071c67709,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=1cb6df63-5dd5-460b-86da-ef0071c67709,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=1cb6df63-5dd5-460b-86da-ef0071c67709,segment=NetworkSegment(4790901f-5695-41bc-be7f-0e3d4d5126bd),segment_id=4790901f-5695-41bc-be7f-0e3d4d5126bd)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:14.722681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-550fbced-74fa-48b0-a4aa-74823f842b6b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (1cb6df63-5dd5-460b-86da-ef0071c67709), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.124853 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:15Z,description='Default security group',id=2a991612-3c8a-4976-9094-135f55a778dd,is_default=True,name='default',project_id='7b1a405bde9742b5acdcb188057441ae',revision_number=1,rules=[SecurityGroupRule(539e99db-6f19-4708-aa09-fb0d406aa854),SecurityGroupRule(784f9f12-43ec-4ca4-9c84-d9393f436c71),SecurityGroupRule(7f5ce790-fbb9-40d4-8f03-35ef4affbfe7),SecurityGroupRule(a19555c6-0ddd-43dc-94cb-c02d40aaae94)],shared=False,stateful=True,updated_at=2022-09-27T04:21:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:15.125365 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (2a991612-3c8a-4976-9094-135f55a778dd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.133519 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:15Z,description=,direction='egress',ethertype='IPv6',id=539e99db-6f19-4708-aa09-fb0d406aa854,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b1a405bde9742b5acdcb188057441ae',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a991612-3c8a-4976-9094-135f55a778dd,updated_at=2022-09-27T04:21:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:15.134358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (539e99db-6f19-4708-aa09-fb0d406aa854), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.135262 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Security group rule updated ['2a991612-3c8a-4976-9094-135f55a778dd'] Sep 27 04:21:15.136493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:15Z,description=,direction='ingress',ethertype='IPv4',id=784f9f12-43ec-4ca4-9c84-d9393f436c71,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b1a405bde9742b5acdcb188057441ae',protocol=,remote_address_group_id=,remote_group_id=2a991612-3c8a-4976-9094-135f55a778dd,remote_ip_prefix=,revision_number=0,security_group_id=2a991612-3c8a-4976-9094-135f55a778dd,updated_at=2022-09-27T04:21:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:15.136862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (784f9f12-43ec-4ca4-9c84-d9393f436c71), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.137584 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Security group rule updated ['2a991612-3c8a-4976-9094-135f55a778dd'] Sep 27 04:21:15.138500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:15Z,description=,direction='egress',ethertype='IPv4',id=7f5ce790-fbb9-40d4-8f03-35ef4affbfe7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b1a405bde9742b5acdcb188057441ae',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a991612-3c8a-4976-9094-135f55a778dd,updated_at=2022-09-27T04:21:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:15.138913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7f5ce790-fbb9-40d4-8f03-35ef4affbfe7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.140177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Security group rule updated ['2a991612-3c8a-4976-9094-135f55a778dd'] Sep 27 04:21:15.141943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:15Z,description=,direction='ingress',ethertype='IPv6',id=a19555c6-0ddd-43dc-94cb-c02d40aaae94,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b1a405bde9742b5acdcb188057441ae',protocol=,remote_address_group_id=,remote_group_id=2a991612-3c8a-4976-9094-135f55a778dd,remote_ip_prefix=,revision_number=0,security_group_id=2a991612-3c8a-4976-9094-135f55a778dd,updated_at=2022-09-27T04:21:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:15.143348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a19555c6-0ddd-43dc-94cb-c02d40aaae94), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.143950 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-708eb397-b81f-4d49-b045-e1d0a52d5be7 admin admin] Security group rule updated ['2a991612-3c8a-4976-9094-135f55a778dd'] Sep 27 04:21:15.292635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Resource SecurityGroup deleted: 2a991612-3c8a-4976-9094-135f55a778dd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:15.293018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (2a991612-3c8a-4976-9094-135f55a778dd), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.294244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2a991612-3c8a-4976-9094-135f55a778dd',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:15.334126 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2a991612-3c8a-4976-9094-135f55a778dd',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:15.334734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Resource SecurityGroupRule deleted: 539e99db-6f19-4708-aa09-fb0d406aa854 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:15.344640 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (539e99db-6f19-4708-aa09-fb0d406aa854), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.345247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Security group rule updated ['2a991612-3c8a-4976-9094-135f55a778dd'] Sep 27 04:21:15.345914 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Resource SecurityGroupRule deleted: 784f9f12-43ec-4ca4-9c84-d9393f436c71 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:15.346757 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (784f9f12-43ec-4ca4-9c84-d9393f436c71), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.347100 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Security group rule updated ['2a991612-3c8a-4976-9094-135f55a778dd'] Sep 27 04:21:15.347463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Resource SecurityGroupRule deleted: 7f5ce790-fbb9-40d4-8f03-35ef4affbfe7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:15.348005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7f5ce790-fbb9-40d4-8f03-35ef4affbfe7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.348511 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Security group rule updated ['2a991612-3c8a-4976-9094-135f55a778dd'] Sep 27 04:21:15.349073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Resource SecurityGroupRule deleted: a19555c6-0ddd-43dc-94cb-c02d40aaae94 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:15.349605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a19555c6-0ddd-43dc-94cb-c02d40aaae94), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.350140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-174da8fd-c005-4453-b89b-5cd7fffd1c8e admin admin] Security group rule updated ['2a991612-3c8a-4976-9094-135f55a778dd'] Sep 27 04:21:15.355931 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-83c29e2f-8565-47a1-92c3-d33d4346fe6d None None] Resource Port 1cb6df63-5dd5-460b-86da-ef0071c67709 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:15.356308 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-83c29e2f-8565-47a1-92c3-d33d4346fe6d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (1cb6df63-5dd5-460b-86da-ef0071c67709), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.470530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:276 started Sep 27 04:21:15.475749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c25,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=299000000,duration_sec=565,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:15.476914 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:15.477486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:276 - starting polling. Elapsed:0.007 Sep 27 04:21:15.482038 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:15.485520 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:276 - port information retrieved. Elapsed:0.015 Sep 27 04:21:15.486149 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '3a195ca1-f95a-4b00-b874-500af40a79fd', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': set(), 'updated': {'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '1cb6df63-5dd5-460b-86da-ef0071c67709'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:15.486765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'device_id': '86f1d0b9-3657-437b-ae62-2e9ed22d6485', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'mac_address': 'fa:16:3e:da:63:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.120'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:15.487320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '1cb6df63-5dd5-460b-86da-ef0071c67709', 'device_id': '86f1d0b9-3657-437b-ae62-2e9ed22d6485', 'network_id': '3b03541e-a362-4f1f-858b-b7051275090d', 'port_id': '1cb6df63-5dd5-460b-86da-ef0071c67709', 'mac_address': 'fa:16:3e:88:33:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 132, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d4a66ea-0873-4a30-ab4a-55cd0b629103', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:15.490451 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: b4d8a087-7ecc-4c15-a09e-d89340dc105d {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:15.490969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b4d8a087-7ecc-4c15-a09e-d89340dc105d updated. Details: {'device': 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'device_id': '86f1d0b9-3657-437b-ae62-2e9ed22d6485', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'mac_address': 'fa:16:3e:da:63:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.120'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:21:15.492425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b4d8a087-7e, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:15.493008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-b4d8a087-7e, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:15.494224 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-b4d8a087-7e, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:15.495116 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:15.497373 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b4d8a087-7e, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:15.498718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:15.501837 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c27,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:15.502405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 1cb6df63-5dd5-460b-86da-ef0071c67709 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:15.503188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 1cb6df63-5dd5-460b-86da-ef0071c67709 updated. Details: {'device': '1cb6df63-5dd5-460b-86da-ef0071c67709', 'device_id': '86f1d0b9-3657-437b-ae62-2e9ed22d6485', 'network_id': '3b03541e-a362-4f1f-858b-b7051275090d', 'port_id': '1cb6df63-5dd5-460b-86da-ef0071c67709', 'mac_address': 'fa:16:3e:88:33:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 132, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d4a66ea-0873-4a30-ab4a-55cd0b629103', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Sep 27 04:21:15.504127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1cb6df63-5d, col_values=(('tag', 7),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:15.504553 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-1cb6df63-5d, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:15.504979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-1cb6df63-5d, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:15.512086 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1cb6df63-5d, col_values=(('other_config', {'net_uuid': '3b03541e-a362-4f1f-858b-b7051275090d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '132'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:15.522979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c29,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:15.525233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:276 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.037 Sep 27 04:21:15.525955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 2 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:21:15.527631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:21:15.532787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:15.533073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:15.542932 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:15.603288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[896a0958-f2ad-49e1-b177-dd9a7fea4b5c]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:15.604182 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:276 - agent port security group processed in 0.118 Sep 27 04:21:15.605139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for b4d8a087-7ecc-4c15-a09e-d89340dc105d to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:15.605616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 1cb6df63-5dd5-460b-86da-ef0071c67709 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:15.940947 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['b4d8a087-7ecc-4c15-a09e-d89340dc105d', '1cb6df63-5dd5-460b-86da-ef0071c67709'] and devices down [] completed. Sep 27 04:21:15.941283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:276 - ports processed. Elapsed:0.471 Sep 27 04:21:15.941721 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:276 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.471 Sep 27 04:21:16.450604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:16Z,description='Default security group',id=2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66,is_default=True,name='default',project_id='7e7b2ff0f0104769a550d0c0692ab713',revision_number=1,rules=[SecurityGroupRule(47250827-9138-4f13-8f81-4c5147609fce),SecurityGroupRule(bbe127b5-2281-48f8-b9ee-f1fc4cebf5a5),SecurityGroupRule(c3151354-81f8-48cb-82d2-3d5ab76bbdfe),SecurityGroupRule(de098977-6032-41fc-8b97-14e72c891fa7)],shared=False,stateful=True,updated_at=2022-09-27T04:21:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:16.450991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:16.451643 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:16Z,description=,direction='ingress',ethertype='IPv4',id=47250827-9138-4f13-8f81-4c5147609fce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol=,remote_address_group_id=,remote_group_id=2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66,remote_ip_prefix=,revision_number=0,security_group_id=2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66,updated_at=2022-09-27T04:21:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:16.452062 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (47250827-9138-4f13-8f81-4c5147609fce), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:16.452400 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Security group rule updated ['2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'] Sep 27 04:21:16.453083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:16Z,description=,direction='ingress',ethertype='IPv6',id=bbe127b5-2281-48f8-b9ee-f1fc4cebf5a5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol=,remote_address_group_id=,remote_group_id=2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66,remote_ip_prefix=,revision_number=0,security_group_id=2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66,updated_at=2022-09-27T04:21:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:16.453439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (bbe127b5-2281-48f8-b9ee-f1fc4cebf5a5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:16.453779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Security group rule updated ['2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'] Sep 27 04:21:16.454596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:16Z,description=,direction='egress',ethertype='IPv6',id=c3151354-81f8-48cb-82d2-3d5ab76bbdfe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66,updated_at=2022-09-27T04:21:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:16.454946 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c3151354-81f8-48cb-82d2-3d5ab76bbdfe), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:16.455667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Security group rule updated ['2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'] Sep 27 04:21:16.456260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:16Z,description=,direction='egress',ethertype='IPv4',id=de098977-6032-41fc-8b97-14e72c891fa7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66,updated_at=2022-09-27T04:21:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:16.456636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (de098977-6032-41fc-8b97-14e72c891fa7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:16.457126 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Security group rule updated ['2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'] Sep 27 04:21:16.593193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:21:16Z,description='',dns_domain=None,id=8bc82a56-69c2-484f-aa08-23831b7e71a2,mtu=1500,name='tempest-TestMinimumBasicScenario-387466124-network',project_id='7e7b2ff0f0104769a550d0c0692ab713',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(8bc82a56-69c2-484f-aa08-23831b7e71a2),segments=[NetworkSegment(39fbe748-2b18-4d3a-b683-ef5d7bb2f520)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:21:16Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:16.594461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (8bc82a56-69c2-484f-aa08-23831b7e71a2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-a64060b8-351d-40b7-8c6e-934634762826 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 8bc82a56-69c2-484f-aa08-23831b7e71a2 with segmentation id not found. Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:21:16.678158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:21:16.679005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:21:16.679005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:21:16.679005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:21:16.679005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 8bc82a56-69c2-484f-aa08-23831b7e71a2 with segmentation id not found. Sep 27 04:21:16.679005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:21:17.090144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4ba7aad8-101b-4623-a135-f1ac03b2306a admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(bba07bba-2ac9-4d45-9790-af76da19e61d)],cidr=172.20.0.0/28,created_at=2022-09-27T04:21:16Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=fd63d32a-4d29-4e2e-ae4d-0ed8efa71b40,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-387466124-subnet',network_id=8bc82a56-69c2-484f-aa08-23831b7e71a2,project_id='7e7b2ff0f0104769a550d0c0692ab713',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:21:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:17.090924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4ba7aad8-101b-4623-a135-f1ac03b2306a admin admin] Publish callbacks [] for Subnet (fd63d32a-4d29-4e2e-ae4d-0ed8efa71b40), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:17.471344 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:277 started Sep 27 04:21:17.473784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c2b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=298000000,duration_sec=567,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:17.474664 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:17.475231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:277 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:21:17.695801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f803769b-7d6f-4fd4-865a-9f2a2791e7c2 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:17Z,data_plane_status=None,description='',device_id='e5e47978-60aa-4191-b5c0-f6421a4e7e97',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b602518b-6faa-4bc5-b2ba-22e555f27363,mac_address=fa:16:3e:67:12:68,name='',network_id=3b03541e-a362-4f1f-858b-b7051275090d,numa_affinity_policy=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b602518b-6faa-4bc5-b2ba-22e555f27363),security_group_ids=set([dad0251b-74f4-4f16-a784-be5aec073ee7]),status='DOWN',updated_at=2022-09-27T04:21:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:17.697026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f803769b-7d6f-4fd4-865a-9f2a2791e7c2 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b602518b-6faa-4bc5-b2ba-22e555f27363), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:17.698147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f803769b-7d6f-4fd4-865a-9f2a2791e7c2 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group member updated {'dad0251b-74f4-4f16-a784-be5aec073ee7'} Sep 27 04:21:17.790727 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7ccd3362-6a5e-44e5-898f-d70cb5a50356 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:17Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-8bc82a56-69c2-484f-aa08-23831b7e71a2',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ae327828-ee82-4fa3-8699-6f3a43b0bdf1,mac_address=fa:16:3e:36:fb:05,name='',network_id=8bc82a56-69c2-484f-aa08-23831b7e71a2,numa_affinity_policy=,project_id='7e7b2ff0f0104769a550d0c0692ab713',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ae327828-ee82-4fa3-8699-6f3a43b0bdf1),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:17.791496 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7ccd3362-6a5e-44e5-898f-d70cb5a50356 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ae327828-ee82-4fa3-8699-6f3a43b0bdf1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:18.187850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7ccd3362-6a5e-44e5-898f-d70cb5a50356 None None] Resource Port ae327828-ee82-4fa3-8699-6f3a43b0bdf1 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=ae327828-ee82-4fa3-8699-6f3a43b0bdf1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=ae327828-ee82-4fa3-8699-6f3a43b0bdf1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=ae327828-ee82-4fa3-8699-6f3a43b0bdf1,segment=NetworkSegment(39fbe748-2b18-4d3a-b683-ef5d7bb2f520),segment_id=39fbe748-2b18-4d3a-b683-ef5d7bb2f520)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:18.188235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7ccd3362-6a5e-44e5-898f-d70cb5a50356 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ae327828-ee82-4fa3-8699-6f3a43b0bdf1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:18.340543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2bd7c862-8d47-4262-a5a5-0a9471569f78 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:17Z,data_plane_status=None,description='',device_id='7bfb2ede-7aac-43a6-a902-ea038748149d',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=afdb5bd9-6267-4259-a055-9a22757a36e0,mac_address=fa:16:3e:af:cd:fc,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(afdb5bd9-6267-4259-a055-9a22757a36e0),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:18Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:18.341528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2bd7c862-8d47-4262-a5a5-0a9471569f78 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (afdb5bd9-6267-4259-a055-9a22757a36e0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:18.346423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cc39a407-3803-47ac-b1f6-fd7de0e5a692","insert","tapae327828-ee",["set",[]],["map",[["attached-mac","fa:16:3e:36:fb:05"],["iface-id","ae327828-ee82-4fa3-8699-6f3a43b0bdf1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:18.379986 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cc39a407-3803-47ac-b1f6-fd7de0e5a692","old",null,["set",[]],null],["","new","tapae327828-ee",18,["map",[["attached-mac","fa:16:3e:36:fb:05"],["iface-id","ae327828-ee82-4fa3-8699-6f3a43b0bdf1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:18.643594 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e3e80d1a-8d82-4545-9b18-21551c8a4658 service neutron] Resource Port b602518b-6faa-4bc5-b2ba-22e555f27363 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=b602518b-6faa-4bc5-b2ba-22e555f27363,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=b602518b-6faa-4bc5-b2ba-22e555f27363,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:18.644114 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e3e80d1a-8d82-4545-9b18-21551c8a4658 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b602518b-6faa-4bc5-b2ba-22e555f27363), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:18.984607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e3e80d1a-8d82-4545-9b18-21551c8a4658 service neutron] Resource Port b602518b-6faa-4bc5-b2ba-22e555f27363 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=b602518b-6faa-4bc5-b2ba-22e555f27363,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=b602518b-6faa-4bc5-b2ba-22e555f27363,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=b602518b-6faa-4bc5-b2ba-22e555f27363,segment=NetworkSegment(4790901f-5695-41bc-be7f-0e3d4d5126bd),segment_id=4790901f-5695-41bc-be7f-0e3d4d5126bd)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:18.987961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e3e80d1a-8d82-4545-9b18-21551c8a4658 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b602518b-6faa-4bc5-b2ba-22e555f27363), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:19.485018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:278 started Sep 27 04:21:19.489655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c2d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=313000000,duration_sec=569,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:19.490768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:19.491455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:278 - starting polling. Elapsed:0.007 Sep 27 04:21:19.493914 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:19.497025 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:278 - port information retrieved. Elapsed:0.012 Sep 27 04:21:19.497616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '3a195ca1-f95a-4b00-b874-500af40a79fd', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'ae327828-ee82-4fa3-8699-6f3a43b0bdf1'}, 'removed': set(), 'updated': {'ae327828-ee82-4fa3-8699-6f3a43b0bdf1'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:19.498459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-8bc82a56-69c2-484f-aa08-23831b7e71a2', 'network_id': '8bc82a56-69c2-484f-aa08-23831b7e71a2', 'port_id': 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'mac_address': 'fa:16:3e:36:fb:05', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 134, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'fd63d32a-4d29-4e2e-ae4d-0ed8efa71b40', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:19.502827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: ae327828-ee82-4fa3-8699-6f3a43b0bdf1 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:19.503376 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ae327828-ee82-4fa3-8699-6f3a43b0bdf1 updated. Details: {'device': 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-8bc82a56-69c2-484f-aa08-23831b7e71a2', 'network_id': '8bc82a56-69c2-484f-aa08-23831b7e71a2', 'port_id': 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'mac_address': 'fa:16:3e:36:fb:05', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 134, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'fd63d32a-4d29-4e2e-ae4d-0ed8efa71b40', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:21:19.503972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 8 as local vlan for net-id=8bc82a56-69c2-484f-aa08-23831b7e71a2, seg-id=134 Sep 27 04:21:19.508853 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32eab,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4230), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:19.512483 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22c2f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4104)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4230}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:19.513463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapae327828-ee, col_values=(('tag', 8),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:19.514293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapae327828-ee, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:19.515498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapae327828-ee, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:19.521089 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapae327828-ee, col_values=(('other_config', {'net_uuid': '8bc82a56-69c2-484f-aa08-23831b7e71a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '134'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:19.532213 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c31,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:19.532701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:278 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.034 Sep 27 04:21:19.533133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:21:19.533513 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'ae327828-ee82-4fa3-8699-6f3a43b0bdf1'} Sep 27 04:21:19.535785 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:19.537228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:19.541993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:19.616818 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[93082678-b688-4ed1-b9c0-792b48e1fcb4]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:19.617449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:278 - agent port security group processed in 0.119 Sep 27 04:21:19.618218 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for ae327828-ee82-4fa3-8699-6f3a43b0bdf1 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:20.425046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['ae327828-ee82-4fa3-8699-6f3a43b0bdf1'] and devices down [] completed. Sep 27 04:21:20.427324 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:278 - ports processed. Elapsed:0.941 Sep 27 04:21:20.427858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:278 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.943 Sep 27 04:21:20.499799 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8b116b27-70a5-4c82-a5d7-22f3cf0fccc9 None None] Resource Port ae327828-ee82-4fa3-8699-6f3a43b0bdf1 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:20.500171 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8b116b27-70a5-4c82-a5d7-22f3cf0fccc9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ae327828-ee82-4fa3-8699-6f3a43b0bdf1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:20.669942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a34d2b6d-ca01-4fe4-abb2-ba99726db76b admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:20Z,data_plane_status=None,description='',device_id='7bfb2ede-7aac-43a6-a902-ea038748149d',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=64ae3c33-5c89-43f1-a306-96b7cf55eb68,mac_address=fa:16:3e:fc:db:59,name='',network_id=8bc82a56-69c2-484f-aa08-23831b7e71a2,numa_affinity_policy=,project_id='7e7b2ff0f0104769a550d0c0692ab713',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(64ae3c33-5c89-43f1-a306-96b7cf55eb68),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:20Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:20.670092 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a34d2b6d-ca01-4fe4-abb2-ba99726db76b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (64ae3c33-5c89-43f1-a306-96b7cf55eb68), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:20.966236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-72b4abc3-38be-41d7-81b0-3a21a1ba21ac None None] Resource Port afdb5bd9-6267-4259-a055-9a22757a36e0 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=afdb5bd9-6267-4259-a055-9a22757a36e0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=afdb5bd9-6267-4259-a055-9a22757a36e0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:20.966729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-72b4abc3-38be-41d7-81b0-3a21a1ba21ac None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (afdb5bd9-6267-4259-a055-9a22757a36e0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:21.119356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a34d2b6d-ca01-4fe4-abb2-ba99726db76b admin admin] Received resource Port update without any changes: 64ae3c33-5c89-43f1-a306-96b7cf55eb68 {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:21:21.190468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-72b4abc3-38be-41d7-81b0-3a21a1ba21ac None None] Resource Port afdb5bd9-6267-4259-a055-9a22757a36e0 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=afdb5bd9-6267-4259-a055-9a22757a36e0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=afdb5bd9-6267-4259-a055-9a22757a36e0,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=afdb5bd9-6267-4259-a055-9a22757a36e0,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:21.190864 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-72b4abc3-38be-41d7-81b0-3a21a1ba21ac None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (afdb5bd9-6267-4259-a055-9a22757a36e0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:21.488397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:279 started Sep 27 04:21:21.491570 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c33,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=315000000,duration_sec=571,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:21.492251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:21.492637 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:279 - starting polling. Elapsed:0.004 Sep 27 04:21:21.503802 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:21.506851 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:279 - port information retrieved. Elapsed:0.019 Sep 27 04:21:21.507197 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '3a195ca1-f95a-4b00-b874-500af40a79fd', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': set(), 'updated': {'ae327828-ee82-4fa3-8699-6f3a43b0bdf1'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:21.508444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-8bc82a56-69c2-484f-aa08-23831b7e71a2', 'network_id': '8bc82a56-69c2-484f-aa08-23831b7e71a2', 'port_id': 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'mac_address': 'fa:16:3e:36:fb:05', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 134, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'fd63d32a-4d29-4e2e-ae4d-0ed8efa71b40', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:21.511131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: ae327828-ee82-4fa3-8699-6f3a43b0bdf1 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:21.511409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ae327828-ee82-4fa3-8699-6f3a43b0bdf1 updated. Details: {'device': 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-8bc82a56-69c2-484f-aa08-23831b7e71a2', 'network_id': '8bc82a56-69c2-484f-aa08-23831b7e71a2', 'port_id': 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'mac_address': 'fa:16:3e:36:fb:05', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 134, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'fd63d32a-4d29-4e2e-ae4d-0ed8efa71b40', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 27 04:21:21.512628 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapae327828-ee, col_values=(('tag', 8),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:21.513241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapae327828-ee, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:21.513636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapae327828-ee, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:21.514334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:21.516537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapae327828-ee, col_values=(('other_config', {'net_uuid': '8bc82a56-69c2-484f-aa08-23831b7e71a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '134', 'tag': '8'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:21.517225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:21.520309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c35,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:21.520670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:279 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.012 Sep 27 04:21:21.521030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:21:21.521325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:21:21.522508 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:21.522792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:21.527121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:21.591152 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[206e3ece-1cbc-4e2d-958b-e1e6bf5f09ae]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:21.591844 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:279 - agent port security group processed in 0.084 Sep 27 04:21:21.592584 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for ae327828-ee82-4fa3-8699-6f3a43b0bdf1 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:21.737349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aa988e3d-5dca-4a22-aef6-924aa08f89b4","insert","qr-64ae3c33-5c",["set",[]],["map",[["attached-mac","fa:16:3e:fc:db:59"],["iface-id","64ae3c33-5c89-43f1-a306-96b7cf55eb68"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:21.762858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aa988e3d-5dca-4a22-aef6-924aa08f89b4","old",null,["set",[]],null],["","new","qr-64ae3c33-5c",19,["map",[["attached-mac","fa:16:3e:fc:db:59"],["iface-id","64ae3c33-5c89-43f1-a306-96b7cf55eb68"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:21.774733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['ae327828-ee82-4fa3-8699-6f3a43b0bdf1'] and devices down [] completed. Sep 27 04:21:21.775096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:279 - ports processed. Elapsed:0.287 Sep 27 04:21:21.775472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:279 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.287 Sep 27 04:21:22.304089 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:22Z,description='Default security group',id=5fced9ee-33f6-413a-8761-efe988f6ef5a,is_default=True,name='default',project_id='3030064c1315435699a7e7d5a831a5b2',revision_number=1,rules=[SecurityGroupRule(43125dc7-25b6-4588-a1bc-5c070f9a8778),SecurityGroupRule(6661a9ce-58e7-476c-a3f5-7e5262e397ea),SecurityGroupRule(7d5ec4cd-14f9-4cea-b532-e4687a2bb956),SecurityGroupRule(fdd4a177-b6b6-4cf4-9bce-dbf8d6f1ec1a)],shared=False,stateful=True,updated_at=2022-09-27T04:21:22Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:22.304677 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (5fced9ee-33f6-413a-8761-efe988f6ef5a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:22.305671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:22Z,description=,direction='ingress',ethertype='IPv4',id=43125dc7-25b6-4588-a1bc-5c070f9a8778,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3030064c1315435699a7e7d5a831a5b2',protocol=,remote_address_group_id=,remote_group_id=5fced9ee-33f6-413a-8761-efe988f6ef5a,remote_ip_prefix=,revision_number=0,security_group_id=5fced9ee-33f6-413a-8761-efe988f6ef5a,updated_at=2022-09-27T04:21:22Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:22.306546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (43125dc7-25b6-4588-a1bc-5c070f9a8778), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:22.307167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Security group rule updated ['5fced9ee-33f6-413a-8761-efe988f6ef5a'] Sep 27 04:21:22.308158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:22Z,description=,direction='egress',ethertype='IPv6',id=6661a9ce-58e7-476c-a3f5-7e5262e397ea,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3030064c1315435699a7e7d5a831a5b2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5fced9ee-33f6-413a-8761-efe988f6ef5a,updated_at=2022-09-27T04:21:22Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:22.309263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6661a9ce-58e7-476c-a3f5-7e5262e397ea), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:22.309672 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Security group rule updated ['5fced9ee-33f6-413a-8761-efe988f6ef5a'] Sep 27 04:21:22.310524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:22Z,description=,direction='egress',ethertype='IPv4',id=7d5ec4cd-14f9-4cea-b532-e4687a2bb956,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3030064c1315435699a7e7d5a831a5b2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5fced9ee-33f6-413a-8761-efe988f6ef5a,updated_at=2022-09-27T04:21:22Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:22.311017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7d5ec4cd-14f9-4cea-b532-e4687a2bb956), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:22.311493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Security group rule updated ['5fced9ee-33f6-413a-8761-efe988f6ef5a'] Sep 27 04:21:22.312824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:22Z,description=,direction='ingress',ethertype='IPv6',id=fdd4a177-b6b6-4cf4-9bce-dbf8d6f1ec1a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3030064c1315435699a7e7d5a831a5b2',protocol=,remote_address_group_id=,remote_group_id=5fced9ee-33f6-413a-8761-efe988f6ef5a,remote_ip_prefix=,revision_number=0,security_group_id=5fced9ee-33f6-413a-8761-efe988f6ef5a,updated_at=2022-09-27T04:21:22Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:22.313310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (fdd4a177-b6b6-4cf4-9bce-dbf8d6f1ec1a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:22.314066 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Security group rule updated ['5fced9ee-33f6-413a-8761-efe988f6ef5a'] Sep 27 04:21:22.315793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4fe52d00-b14c-49bf-9204-b0b990dd6fa0","insert","qg-afdb5bd9-62",["set",[]],["map",[["attached-mac","fa:16:3e:af:cd:fc"],["iface-id","afdb5bd9-6267-4259-a055-9a22757a36e0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:22.358949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4fe52d00-b14c-49bf-9204-b0b990dd6fa0","old",null,["set",[]],null],["","new","qg-afdb5bd9-62",20,["map",[["attached-mac","fa:16:3e:af:cd:fc"],["iface-id","afdb5bd9-6267-4259-a055-9a22757a36e0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:22.494125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:21:22Z,description='',dns_domain=None,id=dfbfe995-da26-4e0f-85ea-0bd48f57c792,mtu=1500,name='tempest-TestMinimumBasicScenario-851602977-network',project_id='3030064c1315435699a7e7d5a831a5b2',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(dfbfe995-da26-4e0f-85ea-0bd48f57c792),segments=[NetworkSegment(4925f116-3860-41b1-90b3-6d928caf6ff7)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:21:22Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:22.494827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (dfbfe995-da26-4e0f-85ea-0bd48f57c792), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-cc8423bb-c322-4552-a608-02ec13cea587 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network dfbfe995-da26-4e0f-85ea-0bd48f57c792 with segmentation id not found. Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:21:22.584397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:21:22.585232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:21:22.585232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:21:22.585232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:21:22.585232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network dfbfe995-da26-4e0f-85ea-0bd48f57c792 with segmentation id not found. Sep 27 04:21:22.585232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:21:22.772626 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-68db3a0b-9117-44ba-8246-3390e8212e5b admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(4f8df355-f033-4956-b23c-0e58ae7466d0)],cidr=172.20.0.0/28,created_at=2022-09-27T04:21:22Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=35f4deae-7512-4fb1-9c36-36796c3f5f81,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-851602977-subnet',network_id=dfbfe995-da26-4e0f-85ea-0bd48f57c792,project_id='3030064c1315435699a7e7d5a831a5b2',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:21:22Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:22.773088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-68db3a0b-9117-44ba-8246-3390e8212e5b admin admin] Publish callbacks [] for Subnet (35f4deae-7512-4fb1-9c36-36796c3f5f81), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:23.385179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bde5015b-8595-4a5a-8648-a933dca7f0df None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:22Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-dfbfe995-da26-4e0f-85ea-0bd48f57c792',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=854192e1-9dfd-42be-9854-8eaac296377e,mac_address=fa:16:3e:47:49:7a,name='',network_id=dfbfe995-da26-4e0f-85ea-0bd48f57c792,numa_affinity_policy=,project_id='3030064c1315435699a7e7d5a831a5b2',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(854192e1-9dfd-42be-9854-8eaac296377e),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:23Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:23.385649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bde5015b-8595-4a5a-8648-a933dca7f0df None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (854192e1-9dfd-42be-9854-8eaac296377e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:23.490263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:280 started Sep 27 04:21:23.492930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c37,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=317000000,duration_sec=573,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:23.494531 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:23.496897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:280 - starting polling. Elapsed:0.005 Sep 27 04:21:23.510184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:23.513517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:280 - port information retrieved. Elapsed:0.024 Sep 27 04:21:23.514142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'64ae3c33-5c89-43f1-a306-96b7cf55eb68', '133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '3a195ca1-f95a-4b00-b874-500af40a79fd', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'afdb5bd9-6267-4259-a055-9a22757a36e0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': {'afdb5bd9-6267-4259-a055-9a22757a36e0', '64ae3c33-5c89-43f1-a306-96b7cf55eb68'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:23.515000 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'device_id': '7bfb2ede-7aac-43a6-a902-ea038748149d', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'mac_address': 'fa:16:3e:af:cd:fc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.209'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:23.515812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:20Z,data_plane_status=None,description='',device_id='7bfb2ede-7aac-43a6-a902-ea038748149d',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=64ae3c33-5c89-43f1-a306-96b7cf55eb68,mac_address=fa:16:3e:fc:db:59,name='',network_id=8bc82a56-69c2-484f-aa08-23831b7e71a2,numa_affinity_policy=,project_id='7e7b2ff0f0104769a550d0c0692ab713',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(64ae3c33-5c89-43f1-a306-96b7cf55eb68),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:20Z) is not bound. Sep 27 04:21:23.520789 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: afdb5bd9-6267-4259-a055-9a22757a36e0 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:23.521492 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port afdb5bd9-6267-4259-a055-9a22757a36e0 updated. Details: {'device': 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'device_id': '7bfb2ede-7aac-43a6-a902-ea038748149d', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'mac_address': 'fa:16:3e:af:cd:fc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.209'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:21:23.522813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-afdb5bd9-62, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:23.523620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-afdb5bd9-62, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:23.524241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-afdb5bd9-62, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:23.534809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-afdb5bd9-62, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:23.551763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c39,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:23.552110 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 64ae3c33-5c89-43f1-a306-96b7cf55eb68 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:23.552408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device 64ae3c33-5c89-43f1-a306-96b7cf55eb68 not defined on plugin or binding failed Sep 27 04:21:23.552960 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:280 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.038 Sep 27 04:21:23.553320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 2 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:21:23.553614 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'afdb5bd9-6267-4259-a055-9a22757a36e0', '64ae3c33-5c89-43f1-a306-96b7cf55eb68'} Sep 27 04:21:23.555403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:23.555695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:23.561246 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:23.618366 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[10804d9c-7e58-495f-bde0-bac6c11911eb]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:23.619018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:280 - agent port security group processed in 0.104 Sep 27 04:21:23.619843 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for afdb5bd9-6267-4259-a055-9a22757a36e0 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:23.862260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c33d924c-8d17-41ce-9c49-40da0020805b","insert","tap854192e1-9d",["set",[]],["map",[["attached-mac","fa:16:3e:47:49:7a"],["iface-id","854192e1-9dfd-42be-9854-8eaac296377e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:23.877364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c33d924c-8d17-41ce-9c49-40da0020805b","old",null,["set",[]],null],["","new","tap854192e1-9d",21,["map",[["attached-mac","fa:16:3e:47:49:7a"],["iface-id","854192e1-9dfd-42be-9854-8eaac296377e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:23.984045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d71ef4ab-1126-45e5-ad3d-d5a517a0e2c9 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:23Z,data_plane_status=None,description='',device_id='a62a248c-77d4-4c01-9113-501cdecfa537',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9f7dbaf8-9996-41f1-91fd-9755032671f2,mac_address=fa:16:3e:ab:79:4c,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9f7dbaf8-9996-41f1-91fd-9755032671f2),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:23Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:23.984627 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d71ef4ab-1126-45e5-ad3d-d5a517a0e2c9 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9f7dbaf8-9996-41f1-91fd-9755032671f2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:23.989732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bde5015b-8595-4a5a-8648-a933dca7f0df None None] Resource Port 854192e1-9dfd-42be-9854-8eaac296377e updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=854192e1-9dfd-42be-9854-8eaac296377e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=854192e1-9dfd-42be-9854-8eaac296377e,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=854192e1-9dfd-42be-9854-8eaac296377e,segment=NetworkSegment(4925f116-3860-41b1-90b3-6d928caf6ff7),segment_id=4925f116-3860-41b1-90b3-6d928caf6ff7)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:23.990149 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bde5015b-8595-4a5a-8648-a933dca7f0df None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (854192e1-9dfd-42be-9854-8eaac296377e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:24.220317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['afdb5bd9-6267-4259-a055-9a22757a36e0'] and devices down [] completed. Sep 27 04:21:24.221003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:280 - ports processed. Elapsed:0.731 Sep 27 04:21:24.222303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:280 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:0.731 Sep 27 04:21:24.309019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port afdb5bd9-6267-4259-a055-9a22757a36e0 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=afdb5bd9-6267-4259-a055-9a22757a36e0,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=afdb5bd9-6267-4259-a055-9a22757a36e0,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:24.310328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (afdb5bd9-6267-4259-a055-9a22757a36e0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:24.778756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-aff1ddad-46ff-423a-946c-b066fc1454b6 None None] Resource Port 64ae3c33-5c89-43f1-a306-96b7cf55eb68 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=64ae3c33-5c89-43f1-a306-96b7cf55eb68,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=64ae3c33-5c89-43f1-a306-96b7cf55eb68,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:24.780539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-aff1ddad-46ff-423a-946c-b066fc1454b6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (64ae3c33-5c89-43f1-a306-96b7cf55eb68), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:25.491041 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:281 started Sep 27 04:21:25.494977 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c3b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=318000000,duration_sec=575,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:25.495786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:25.496436 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:281 - starting polling. Elapsed:0.006 Sep 27 04:21:25.500904 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:25.509376 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:281 - port information retrieved. Elapsed:0.018 Sep 27 04:21:25.511968 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '3a195ca1-f95a-4b00-b874-500af40a79fd', 'afdb5bd9-6267-4259-a055-9a22757a36e0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': {'854192e1-9dfd-42be-9854-8eaac296377e'}, 'removed': set(), 'updated': {'854192e1-9dfd-42be-9854-8eaac296377e', 'afdb5bd9-6267-4259-a055-9a22757a36e0', '64ae3c33-5c89-43f1-a306-96b7cf55eb68'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:25.512798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '854192e1-9dfd-42be-9854-8eaac296377e', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'network_id': 'dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'port_id': '854192e1-9dfd-42be-9854-8eaac296377e', 'mac_address': 'fa:16:3e:47:49:7a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35f4deae-7512-4fb1-9c36-36796c3f5f81', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:25.514698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'device_id': '7bfb2ede-7aac-43a6-a902-ea038748149d', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'mac_address': 'fa:16:3e:af:cd:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.209'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:25.516100 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:20Z,data_plane_status=None,description='',device_id='7bfb2ede-7aac-43a6-a902-ea038748149d',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=64ae3c33-5c89-43f1-a306-96b7cf55eb68,mac_address=fa:16:3e:fc:db:59,name='',network_id=8bc82a56-69c2-484f-aa08-23831b7e71a2,numa_affinity_policy=,project_id='7e7b2ff0f0104769a550d0c0692ab713',qos_network_policy_id=None,qos_policy_id=None,revision_number=3,security=PortSecurity(64ae3c33-5c89-43f1-a306-96b7cf55eb68),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:24Z) is not bound. Sep 27 04:21:25.523440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 854192e1-9dfd-42be-9854-8eaac296377e {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:25.525419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 854192e1-9dfd-42be-9854-8eaac296377e updated. Details: {'device': '854192e1-9dfd-42be-9854-8eaac296377e', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'network_id': 'dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'port_id': '854192e1-9dfd-42be-9854-8eaac296377e', 'mac_address': 'fa:16:3e:47:49:7a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35f4deae-7512-4fb1-9c36-36796c3f5f81', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:21:25.528317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 9 as local vlan for net-id=dfbfe995-da26-4e0f-85ea-0bd48f57c792, seg-id=146 Sep 27 04:21:25.545440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32ead,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4242), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:25.553490 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22c3d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4105)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4242}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:25.556261 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap854192e1-9d, col_values=(('tag', 9),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:25.560755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap854192e1-9d, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:25.561431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap854192e1-9d, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:25.572092 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap854192e1-9d, col_values=(('other_config', {'net_uuid': 'dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '146'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:25.589508 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c3f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:25.589889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: afdb5bd9-6267-4259-a055-9a22757a36e0 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:25.590483 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port afdb5bd9-6267-4259-a055-9a22757a36e0 updated. Details: {'device': 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'device_id': '7bfb2ede-7aac-43a6-a902-ea038748149d', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'mac_address': 'fa:16:3e:af:cd:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.209'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:21:25.593765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-afdb5bd9-62, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:25.598827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-afdb5bd9-62, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:25.599535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-afdb5bd9-62, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:25.600544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:25.602205 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-afdb5bd9-62, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:25.603026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:25.613886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c41,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:25.614617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 64ae3c33-5c89-43f1-a306-96b7cf55eb68 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:25.615071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device 64ae3c33-5c89-43f1-a306-96b7cf55eb68 not defined on plugin or binding failed Sep 27 04:21:25.615756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:281 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.103 Sep 27 04:21:25.618604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:21:25.618925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'854192e1-9dfd-42be-9854-8eaac296377e'} Sep 27 04:21:25.620094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:25.620387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:25.631051 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:25.661561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-aff1ddad-46ff-423a-946c-b066fc1454b6 None None] Resource Port 64ae3c33-5c89-43f1-a306-96b7cf55eb68 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=64ae3c33-5c89-43f1-a306-96b7cf55eb68,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=64ae3c33-5c89-43f1-a306-96b7cf55eb68,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=64ae3c33-5c89-43f1-a306-96b7cf55eb68,segment=NetworkSegment(39fbe748-2b18-4d3a-b683-ef5d7bb2f520),segment_id=39fbe748-2b18-4d3a-b683-ef5d7bb2f520)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:25.662265 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-aff1ddad-46ff-423a-946c-b066fc1454b6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (64ae3c33-5c89-43f1-a306-96b7cf55eb68), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:25.691267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f66413-1833-4220-9027-e7e2e70fdb07]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:25.692139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 2 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:21:25.692627 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:21:25.695025 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:25.695469 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:25.700433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:25.789003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f3682e-f474-4835-888a-6fef80267d6e]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:25.791113 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:281 - agent port security group processed in 0.278 Sep 27 04:21:25.792125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 854192e1-9dfd-42be-9854-8eaac296377e to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:25.793046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for afdb5bd9-6267-4259-a055-9a22757a36e0 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:25.992145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e98d96fc-3100-4336-b842-f853f4e5f55f None None] Resource Port 64ae3c33-5c89-43f1-a306-96b7cf55eb68 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:25.992775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e98d96fc-3100-4336-b842-f853f4e5f55f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (64ae3c33-5c89-43f1-a306-96b7cf55eb68), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:26.265593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c6f110c9-6631-4f97-a615-edef704ffc27 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:25Z,data_plane_status=None,description='',device_id='a62a248c-77d4-4c01-9113-501cdecfa537',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ed0a7ee1-975d-4612-a2f5-84b7920a09a0,mac_address=fa:16:3e:9f:35:0f,name='',network_id=dfbfe995-da26-4e0f-85ea-0bd48f57c792,numa_affinity_policy=,project_id='3030064c1315435699a7e7d5a831a5b2',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ed0a7ee1-975d-4612-a2f5-84b7920a09a0),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:25Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:26.266083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c6f110c9-6631-4f97-a615-edef704ffc27 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ed0a7ee1-975d-4612-a2f5-84b7920a09a0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:26.345568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-be3a53e6-68b3-48ed-9969-befaa2de9722 None None] Resource Port 9f7dbaf8-9996-41f1-91fd-9755032671f2 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=9f7dbaf8-9996-41f1-91fd-9755032671f2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=9f7dbaf8-9996-41f1-91fd-9755032671f2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:26.346352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-be3a53e6-68b3-48ed-9969-befaa2de9722 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9f7dbaf8-9996-41f1-91fd-9755032671f2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:26.665319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-34f08bce-d0d7-46e7-a207-e0226b85c583 None None] Resource Port 854192e1-9dfd-42be-9854-8eaac296377e updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:26.668177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-34f08bce-d0d7-46e7-a207-e0226b85c583 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (854192e1-9dfd-42be-9854-8eaac296377e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:26.804260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c6f110c9-6631-4f97-a615-edef704ffc27 admin admin] Received resource Port update without any changes: ed0a7ee1-975d-4612-a2f5-84b7920a09a0 {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:21:27.004692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-be3a53e6-68b3-48ed-9969-befaa2de9722 None None] Resource Port 9f7dbaf8-9996-41f1-91fd-9755032671f2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=9f7dbaf8-9996-41f1-91fd-9755032671f2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=9f7dbaf8-9996-41f1-91fd-9755032671f2,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=9f7dbaf8-9996-41f1-91fd-9755032671f2,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:27.005090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-be3a53e6-68b3-48ed-9969-befaa2de9722 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9f7dbaf8-9996-41f1-91fd-9755032671f2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:27.504892 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['854192e1-9dfd-42be-9854-8eaac296377e', 'afdb5bd9-6267-4259-a055-9a22757a36e0'] and devices down [] completed. Sep 27 04:21:27.505229 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:281 - ports processed. Elapsed:2.014 Sep 27 04:21:27.505580 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:281 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:2.015 Sep 27 04:21:27.506326 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Loop iteration exceeded interval (2 vs. 2.0146923065185547)! {{(pid=107232) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 27 04:21:27.506622 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:282 started Sep 27 04:21:27.509826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c43,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=333000000,duration_sec=577,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:27.510429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:27.510931 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:282 - starting polling. Elapsed:0.004 Sep 27 04:21:27.516386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:27.519945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:282 - port information retrieved. Elapsed:0.013 Sep 27 04:21:27.520600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '3a195ca1-f95a-4b00-b874-500af40a79fd', 'afdb5bd9-6267-4259-a055-9a22757a36e0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': set(), 'updated': {'854192e1-9dfd-42be-9854-8eaac296377e', '64ae3c33-5c89-43f1-a306-96b7cf55eb68'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:27.521347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '854192e1-9dfd-42be-9854-8eaac296377e', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'network_id': 'dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'port_id': '854192e1-9dfd-42be-9854-8eaac296377e', 'mac_address': 'fa:16:3e:47:49:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35f4deae-7512-4fb1-9c36-36796c3f5f81', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:27.521850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '64ae3c33-5c89-43f1-a306-96b7cf55eb68', 'device_id': '7bfb2ede-7aac-43a6-a902-ea038748149d', 'network_id': '8bc82a56-69c2-484f-aa08-23831b7e71a2', 'port_id': '64ae3c33-5c89-43f1-a306-96b7cf55eb68', 'mac_address': 'fa:16:3e:fc:db:59', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 134, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'fd63d32a-4d29-4e2e-ae4d-0ed8efa71b40', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:27.524930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 854192e1-9dfd-42be-9854-8eaac296377e {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:27.525414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 854192e1-9dfd-42be-9854-8eaac296377e updated. Details: {'device': '854192e1-9dfd-42be-9854-8eaac296377e', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'network_id': 'dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'port_id': '854192e1-9dfd-42be-9854-8eaac296377e', 'mac_address': 'fa:16:3e:47:49:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35f4deae-7512-4fb1-9c36-36796c3f5f81', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Sep 27 04:21:27.526792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap854192e1-9d, col_values=(('tag', 9),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:27.527357 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap854192e1-9d, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:27.527750 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap854192e1-9d, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:27.528192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:27.530019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap854192e1-9d, col_values=(('other_config', {'net_uuid': 'dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '146', 'tag': '9'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:27.531439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:27.534058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c45,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:27.534590 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 64ae3c33-5c89-43f1-a306-96b7cf55eb68 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:27.534951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 64ae3c33-5c89-43f1-a306-96b7cf55eb68 updated. Details: {'device': '64ae3c33-5c89-43f1-a306-96b7cf55eb68', 'device_id': '7bfb2ede-7aac-43a6-a902-ea038748149d', 'network_id': '8bc82a56-69c2-484f-aa08-23831b7e71a2', 'port_id': '64ae3c33-5c89-43f1-a306-96b7cf55eb68', 'mac_address': 'fa:16:3e:fc:db:59', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 134, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'fd63d32a-4d29-4e2e-ae4d-0ed8efa71b40', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 27 04:21:27.536414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-64ae3c33-5c, col_values=(('tag', 8),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:27.536830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-64ae3c33-5c, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:27.537734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-64ae3c33-5c, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:27.544880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-64ae3c33-5c, col_values=(('other_config', {'net_uuid': '8bc82a56-69c2-484f-aa08-23831b7e71a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '134'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:27.555714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c47,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:27.556069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:282 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.035 Sep 27 04:21:27.556442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 2 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:21:27.556740 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:21:27.559046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:27.559359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:27.565358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:27.637941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[672af7b1-059c-4514-b356-4d0957fd6032]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:27.638808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:282 - agent port security group processed in 0.118 Sep 27 04:21:27.640679 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 854192e1-9dfd-42be-9854-8eaac296377e to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:27.641498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 64ae3c33-5c89-43f1-a306-96b7cf55eb68 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:27.717386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["233da85b-1d48-444d-88ed-e14def6f521e","insert","qr-ed0a7ee1-97",["set",[]],["map",[["attached-mac","fa:16:3e:9f:35:0f"],["iface-id","ed0a7ee1-975d-4612-a2f5-84b7920a09a0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:27.735171 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["233da85b-1d48-444d-88ed-e14def6f521e","old",null,["set",[]],null],["","new","qr-ed0a7ee1-97",22,["map",[["attached-mac","fa:16:3e:9f:35:0f"],["iface-id","ed0a7ee1-975d-4612-a2f5-84b7920a09a0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:28.172676 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['854192e1-9dfd-42be-9854-8eaac296377e', '64ae3c33-5c89-43f1-a306-96b7cf55eb68'] and devices down [] completed. Sep 27 04:21:28.174046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:282 - ports processed. Elapsed:0.667 Sep 27 04:21:28.174685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:282 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.668 Sep 27 04:21:28.471089 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["64a2c4f0-8d57-40f5-ad69-d671fa2d657f","insert","qg-9f7dbaf8-99",["set",[]],["map",[["attached-mac","fa:16:3e:ab:79:4c"],["iface-id","9f7dbaf8-9996-41f1-91fd-9755032671f2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:28.506489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["64a2c4f0-8d57-40f5-ad69-d671fa2d657f","old",null,["set",[]],null],["","new","qg-9f7dbaf8-99",23,["map",[["attached-mac","fa:16:3e:ab:79:4c"],["iface-id","9f7dbaf8-9996-41f1-91fd-9755032671f2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:21:29.511042 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:283 started Sep 27 04:21:29.514630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c49,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=338000000,duration_sec=579,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:29.515212 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:29.515733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:283 - starting polling. Elapsed:0.005 Sep 27 04:21:29.519425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:29.523247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:283 - port information retrieved. Elapsed:0.012 Sep 27 04:21:29.527084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', 'afdb5bd9-6267-4259-a055-9a22757a36e0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': {'9f7dbaf8-9996-41f1-91fd-9755032671f2', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:29.527926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'device_id': 'a62a248c-77d4-4c01-9113-501cdecfa537', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'mac_address': 'fa:16:3e:ab:79:4c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.110'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:29.531202 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:25Z,data_plane_status=None,description='',device_id='a62a248c-77d4-4c01-9113-501cdecfa537',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ed0a7ee1-975d-4612-a2f5-84b7920a09a0,mac_address=fa:16:3e:9f:35:0f,name='',network_id=dfbfe995-da26-4e0f-85ea-0bd48f57c792,numa_affinity_policy=,project_id='3030064c1315435699a7e7d5a831a5b2',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(ed0a7ee1-975d-4612-a2f5-84b7920a09a0),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:21:26Z) is not bound. Sep 27 04:21:29.534957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 9f7dbaf8-9996-41f1-91fd-9755032671f2 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:29.535743 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 9f7dbaf8-9996-41f1-91fd-9755032671f2 updated. Details: {'device': '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'device_id': 'a62a248c-77d4-4c01-9113-501cdecfa537', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'mac_address': 'fa:16:3e:ab:79:4c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.110'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:21:29.536929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9f7dbaf8-99, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:29.537536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-9f7dbaf8-99, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:29.538150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-9f7dbaf8-99, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:29.550716 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9f7dbaf8-99, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:29.567692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c4b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:29.568317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: ed0a7ee1-975d-4612-a2f5-84b7920a09a0 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:29.568779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device ed0a7ee1-975d-4612-a2f5-84b7920a09a0 not defined on plugin or binding failed Sep 27 04:21:29.569440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:283 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.042 Sep 27 04:21:29.570019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 2 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:21:29.570486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'9f7dbaf8-9996-41f1-91fd-9755032671f2', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0'} Sep 27 04:21:29.572394 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:29.572859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:29.577781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:29.681529 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd94a94-b296-4bdf-8cc3-4e0f39f80410]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:29.682271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:283 - agent port security group processed in 0.155 Sep 27 04:21:29.683066 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 9f7dbaf8-9996-41f1-91fd-9755032671f2 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:29.951016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['9f7dbaf8-9996-41f1-91fd-9755032671f2'] and devices down [] completed. Sep 27 04:21:29.952044 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:283 - ports processed. Elapsed:0.441 Sep 27 04:21:29.952663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:283 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:0.441 Sep 27 04:21:30.009987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port 9f7dbaf8-9996-41f1-91fd-9755032671f2 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=9f7dbaf8-9996-41f1-91fd-9755032671f2,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=9f7dbaf8-9996-41f1-91fd-9755032671f2,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:30.010682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9f7dbaf8-9996-41f1-91fd-9755032671f2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:30.140156 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ffa323b6-15f9-4602-9a2d-aa60ec89b5bc tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:29Z,data_plane_status=None,description='',device_id='d8c4e5f5-b02a-42c7-937e-d41da28f5fa9',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b0f3948b-c804-4958-9c96-5fefbd31faea,mac_address=fa:16:3e:74:19:de,name='',network_id=3b03541e-a362-4f1f-858b-b7051275090d,numa_affinity_policy=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b0f3948b-c804-4958-9c96-5fefbd31faea),security_group_ids=set([dad0251b-74f4-4f16-a784-be5aec073ee7]),status='DOWN',updated_at=2022-09-27T04:21:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:30.141646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ffa323b6-15f9-4602-9a2d-aa60ec89b5bc tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b0f3948b-c804-4958-9c96-5fefbd31faea), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:30.142913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ffa323b6-15f9-4602-9a2d-aa60ec89b5bc tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group member updated {'dad0251b-74f4-4f16-a784-be5aec073ee7'} Sep 27 04:21:30.828226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2e1453cf-0be2-435f-99f2-94dbde78083a service neutron] Resource Port b0f3948b-c804-4958-9c96-5fefbd31faea updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=b0f3948b-c804-4958-9c96-5fefbd31faea,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=b0f3948b-c804-4958-9c96-5fefbd31faea,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:30.828927 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2e1453cf-0be2-435f-99f2-94dbde78083a service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b0f3948b-c804-4958-9c96-5fefbd31faea), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:31.228050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b602518b-6faa-4bc5-b2ba-22e555f27363 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:31.229002 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b602518b-6faa-4bc5-b2ba-22e555f27363), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:31.512230 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:284 started Sep 27 04:21:31.515333 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c4d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=339000000,duration_sec=581,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:31.515943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:31.516282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:284 - starting polling. Elapsed:0.004 Sep 27 04:21:31.519012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:31.522979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:284 - port information retrieved. Elapsed:0.011 Sep 27 04:21:31.523325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', 'afdb5bd9-6267-4259-a055-9a22757a36e0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': set(), 'updated': {'9f7dbaf8-9996-41f1-91fd-9755032671f2'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:31.527241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'device_id': 'a62a248c-77d4-4c01-9113-501cdecfa537', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'mac_address': 'fa:16:3e:ab:79:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.110'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:31.538008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 9f7dbaf8-9996-41f1-91fd-9755032671f2 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:31.538352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 9f7dbaf8-9996-41f1-91fd-9755032671f2 updated. Details: {'device': '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'device_id': 'a62a248c-77d4-4c01-9113-501cdecfa537', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'mac_address': 'fa:16:3e:ab:79:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.110'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:21:31.549469 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9f7dbaf8-99, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:31.550688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-9f7dbaf8-99, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:31.552554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-9f7dbaf8-99, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:31.553628 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:31.558291 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2e1453cf-0be2-435f-99f2-94dbde78083a service neutron] Resource Port b0f3948b-c804-4958-9c96-5fefbd31faea updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=b0f3948b-c804-4958-9c96-5fefbd31faea,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=b0f3948b-c804-4958-9c96-5fefbd31faea,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=b0f3948b-c804-4958-9c96-5fefbd31faea,segment=NetworkSegment(4790901f-5695-41bc-be7f-0e3d4d5126bd),segment_id=4790901f-5695-41bc-be7f-0e3d4d5126bd)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:31.559850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2e1453cf-0be2-435f-99f2-94dbde78083a service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b0f3948b-c804-4958-9c96-5fefbd31faea), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:31.563233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9f7dbaf8-99, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:31.564836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:21:31.580157 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c4f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:31.581273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:284 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.057 Sep 27 04:21:31.581845 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:21:31.582484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:21:31.583996 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:31.586025 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:31.599787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:31.688908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3489f279-1c44-4a6f-8da1-9fa0859f7a7b]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:31.690491 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:284 - agent port security group processed in 0.166 Sep 27 04:21:31.691459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 9f7dbaf8-9996-41f1-91fd-9755032671f2 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:31.943108 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['9f7dbaf8-9996-41f1-91fd-9755032671f2'] and devices down [] completed. Sep 27 04:21:31.943757 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:284 - ports processed. Elapsed:0.431 Sep 27 04:21:31.943757 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:284 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.432 Sep 27 04:21:31.988898 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58d2bcbd-0d1a-4e5e-94aa-2d4df7e974b9 None None] Resource Port ed0a7ee1-975d-4612-a2f5-84b7920a09a0 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=ed0a7ee1-975d-4612-a2f5-84b7920a09a0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=ed0a7ee1-975d-4612-a2f5-84b7920a09a0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:31.990585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58d2bcbd-0d1a-4e5e-94aa-2d4df7e974b9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ed0a7ee1-975d-4612-a2f5-84b7920a09a0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.283381 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58d2bcbd-0d1a-4e5e-94aa-2d4df7e974b9 None None] Resource Port ed0a7ee1-975d-4612-a2f5-84b7920a09a0 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=ed0a7ee1-975d-4612-a2f5-84b7920a09a0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=ed0a7ee1-975d-4612-a2f5-84b7920a09a0,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=ed0a7ee1-975d-4612-a2f5-84b7920a09a0,segment=NetworkSegment(4925f116-3860-41b1-90b3-6d928caf6ff7),segment_id=4925f116-3860-41b1-90b3-6d928caf6ff7)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:32.283786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58d2bcbd-0d1a-4e5e-94aa-2d4df7e974b9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ed0a7ee1-975d-4612-a2f5-84b7920a09a0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.582659 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:32Z,description='Default security group',id=75f978a5-69b5-49b2-bb81-e8a2286aecb1,is_default=True,name='default',project_id='a0c3265513614f2897b64a76b93b7e87',revision_number=1,rules=[SecurityGroupRule(0adb12cd-86b3-4e57-8dbe-06bcbea43423),SecurityGroupRule(69f29d82-c60b-4574-934a-c2154da02dc3),SecurityGroupRule(c260036f-c4e4-4eae-9df2-3fb2302f0341),SecurityGroupRule(fa297daa-b9d8-4b6d-b51b-7e2ff9af4a87)],shared=False,stateful=True,updated_at=2022-09-27T04:21:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:32.583539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (75f978a5-69b5-49b2-bb81-e8a2286aecb1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.584366 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:32Z,description=,direction='ingress',ethertype='IPv4',id=0adb12cd-86b3-4e57-8dbe-06bcbea43423,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0c3265513614f2897b64a76b93b7e87',protocol=,remote_address_group_id=,remote_group_id=75f978a5-69b5-49b2-bb81-e8a2286aecb1,remote_ip_prefix=,revision_number=0,security_group_id=75f978a5-69b5-49b2-bb81-e8a2286aecb1,updated_at=2022-09-27T04:21:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:32.584913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0adb12cd-86b3-4e57-8dbe-06bcbea43423), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.586310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Security group rule updated ['75f978a5-69b5-49b2-bb81-e8a2286aecb1'] Sep 27 04:21:32.587236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:32Z,description=,direction='egress',ethertype='IPv4',id=69f29d82-c60b-4574-934a-c2154da02dc3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0c3265513614f2897b64a76b93b7e87',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=75f978a5-69b5-49b2-bb81-e8a2286aecb1,updated_at=2022-09-27T04:21:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:32.587876 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (69f29d82-c60b-4574-934a-c2154da02dc3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.588523 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Security group rule updated ['75f978a5-69b5-49b2-bb81-e8a2286aecb1'] Sep 27 04:21:32.589620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:32Z,description=,direction='egress',ethertype='IPv6',id=c260036f-c4e4-4eae-9df2-3fb2302f0341,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0c3265513614f2897b64a76b93b7e87',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=75f978a5-69b5-49b2-bb81-e8a2286aecb1,updated_at=2022-09-27T04:21:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:32.590227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c260036f-c4e4-4eae-9df2-3fb2302f0341), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.591231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Security group rule updated ['75f978a5-69b5-49b2-bb81-e8a2286aecb1'] Sep 27 04:21:32.592507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:32Z,description=,direction='ingress',ethertype='IPv6',id=fa297daa-b9d8-4b6d-b51b-7e2ff9af4a87,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0c3265513614f2897b64a76b93b7e87',protocol=,remote_address_group_id=,remote_group_id=75f978a5-69b5-49b2-bb81-e8a2286aecb1,remote_ip_prefix=,revision_number=0,security_group_id=75f978a5-69b5-49b2-bb81-e8a2286aecb1,updated_at=2022-09-27T04:21:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:32.596174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (fa297daa-b9d8-4b6d-b51b-7e2ff9af4a87), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.598106 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-909e46db-ef1b-423a-878c-be92e463ed3e admin admin] Security group rule updated ['75f978a5-69b5-49b2-bb81-e8a2286aecb1'] Sep 27 04:21:32.937047 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Resource SecurityGroup deleted: 75f978a5-69b5-49b2-bb81-e8a2286aecb1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:32.937580 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (75f978a5-69b5-49b2-bb81-e8a2286aecb1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.938215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('75f978a5-69b5-49b2-bb81-e8a2286aecb1',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:32.987117 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('75f978a5-69b5-49b2-bb81-e8a2286aecb1',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:32.987775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Resource SecurityGroupRule deleted: 0adb12cd-86b3-4e57-8dbe-06bcbea43423 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:32.988082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0adb12cd-86b3-4e57-8dbe-06bcbea43423), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.988489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Security group rule updated ['75f978a5-69b5-49b2-bb81-e8a2286aecb1'] Sep 27 04:21:32.988969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Resource SecurityGroupRule deleted: 69f29d82-c60b-4574-934a-c2154da02dc3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:32.989381 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (69f29d82-c60b-4574-934a-c2154da02dc3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.989791 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Security group rule updated ['75f978a5-69b5-49b2-bb81-e8a2286aecb1'] Sep 27 04:21:32.990242 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Resource SecurityGroupRule deleted: c260036f-c4e4-4eae-9df2-3fb2302f0341 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:32.990670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c260036f-c4e4-4eae-9df2-3fb2302f0341), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.991061 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Security group rule updated ['75f978a5-69b5-49b2-bb81-e8a2286aecb1'] Sep 27 04:21:32.991498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Resource SecurityGroupRule deleted: fa297daa-b9d8-4b6d-b51b-7e2ff9af4a87 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:32.992070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (fa297daa-b9d8-4b6d-b51b-7e2ff9af4a87), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:32.992605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ca948bcd-cb54-43cc-b0f2-9564115322b2 admin admin] Security group rule updated ['75f978a5-69b5-49b2-bb81-e8a2286aecb1'] Sep 27 04:21:33.352174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1fc78349-c7bf-45f1-ab7d-79b5ca69a3cd None None] Resource Port ed0a7ee1-975d-4612-a2f5-84b7920a09a0 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:33.352558 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1fc78349-c7bf-45f1-ab7d-79b5ca69a3cd None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ed0a7ee1-975d-4612-a2f5-84b7920a09a0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:33.514257 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:285 started Sep 27 04:21:33.519860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=341000000,duration_sec=583,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:33.524303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:33.524854 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:285 - starting polling. Elapsed:0.011 Sep 27 04:21:33.529263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:33.536904 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:285 - port information retrieved. Elapsed:0.023 Sep 27 04:21:33.537484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', 'afdb5bd9-6267-4259-a055-9a22757a36e0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': set(), 'updated': {'ed0a7ee1-975d-4612-a2f5-84b7920a09a0'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:21:33.538302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', 'device_id': 'a62a248c-77d4-4c01-9113-501cdecfa537', 'network_id': 'dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'port_id': 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', 'mac_address': 'fa:16:3e:9f:35:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35f4deae-7512-4fb1-9c36-36796c3f5f81', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:21:33.542963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: ed0a7ee1-975d-4612-a2f5-84b7920a09a0 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:21:33.543823 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ed0a7ee1-975d-4612-a2f5-84b7920a09a0 updated. Details: {'device': 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', 'device_id': 'a62a248c-77d4-4c01-9113-501cdecfa537', 'network_id': 'dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'port_id': 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', 'mac_address': 'fa:16:3e:9f:35:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35f4deae-7512-4fb1-9c36-36796c3f5f81', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Sep 27 04:21:33.553021 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b602518b-6faa-4bc5-b2ba-22e555f27363 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:33.553692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b602518b-6faa-4bc5-b2ba-22e555f27363), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:33.555246 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-ed0a7ee1-97, col_values=(('tag', 9),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:33.555900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-ed0a7ee1-97, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:33.556629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-ed0a7ee1-97, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:33.576807 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-ed0a7ee1-97, col_values=(('other_config', {'net_uuid': 'dfbfe995-da26-4e0f-85ea-0bd48f57c792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '146'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:21:33.603524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22c53,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:33.604476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:285 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.066 Sep 27 04:21:33.604984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:21:33.605440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:21:33.606796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:21:33.607237 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:21:33.619943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:21:33.686348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[201e2bf4-b8f0-4830-97ec-b14f4f1775eb]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:21:33.686930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:285 - agent port security group processed in 0.149 Sep 27 04:21:33.687660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for ed0a7ee1-975d-4612-a2f5-84b7920a09a0 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:21:33.970934 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['ed0a7ee1-975d-4612-a2f5-84b7920a09a0'] and devices down [] completed. Sep 27 04:21:33.971526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:285 - ports processed. Elapsed:0.457 Sep 27 04:21:33.973192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:285 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.459 Sep 27 04:21:34.088341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:33Z,description='Default security group',id=8d4e5401-3d21-457d-b9fd-5708c624638c,is_default=True,name='default',project_id='8ebcf45fe4054d38839569d76df9565f',revision_number=1,rules=[SecurityGroupRule(04f15b7f-02d9-4f96-9961-f83091132a69),SecurityGroupRule(55a9ee07-3981-4251-9c37-a8edac696841),SecurityGroupRule(6f268e03-009f-45ab-a41f-26477816f8b6),SecurityGroupRule(87119c71-372a-4142-a2cd-fbfb03d5320b)],shared=False,stateful=True,updated_at=2022-09-27T04:21:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:34.088957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (8d4e5401-3d21-457d-b9fd-5708c624638c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:34.089328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:33Z,description=,direction='ingress',ethertype='IPv6',id=04f15b7f-02d9-4f96-9961-f83091132a69,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ebcf45fe4054d38839569d76df9565f',protocol=,remote_address_group_id=,remote_group_id=8d4e5401-3d21-457d-b9fd-5708c624638c,remote_ip_prefix=,revision_number=0,security_group_id=8d4e5401-3d21-457d-b9fd-5708c624638c,updated_at=2022-09-27T04:21:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:34.089988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (04f15b7f-02d9-4f96-9961-f83091132a69), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:34.090489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Security group rule updated ['8d4e5401-3d21-457d-b9fd-5708c624638c'] Sep 27 04:21:34.091559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:33Z,description=,direction='egress',ethertype='IPv4',id=55a9ee07-3981-4251-9c37-a8edac696841,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ebcf45fe4054d38839569d76df9565f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8d4e5401-3d21-457d-b9fd-5708c624638c,updated_at=2022-09-27T04:21:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:34.092147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (55a9ee07-3981-4251-9c37-a8edac696841), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:34.093318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Security group rule updated ['8d4e5401-3d21-457d-b9fd-5708c624638c'] Sep 27 04:21:34.094024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:33Z,description=,direction='egress',ethertype='IPv6',id=6f268e03-009f-45ab-a41f-26477816f8b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ebcf45fe4054d38839569d76df9565f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8d4e5401-3d21-457d-b9fd-5708c624638c,updated_at=2022-09-27T04:21:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:34.094384 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6f268e03-009f-45ab-a41f-26477816f8b6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:34.094713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Security group rule updated ['8d4e5401-3d21-457d-b9fd-5708c624638c'] Sep 27 04:21:34.095388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:33Z,description=,direction='ingress',ethertype='IPv4',id=87119c71-372a-4142-a2cd-fbfb03d5320b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ebcf45fe4054d38839569d76df9565f',protocol=,remote_address_group_id=,remote_group_id=8d4e5401-3d21-457d-b9fd-5708c624638c,remote_ip_prefix=,revision_number=0,security_group_id=8d4e5401-3d21-457d-b9fd-5708c624638c,updated_at=2022-09-27T04:21:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:34.095738 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (87119c71-372a-4142-a2cd-fbfb03d5320b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:34.096066 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bdea2781-ab0c-4151-acbc-7443dd5f148f admin admin] Security group rule updated ['8d4e5401-3d21-457d-b9fd-5708c624638c'] Sep 27 04:21:34.337002 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Resource SecurityGroup deleted: 8d4e5401-3d21-457d-b9fd-5708c624638c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:34.337303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (8d4e5401-3d21-457d-b9fd-5708c624638c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:34.337868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8d4e5401-3d21-457d-b9fd-5708c624638c',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:34.353304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8d4e5401-3d21-457d-b9fd-5708c624638c',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:34.354055 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Resource SecurityGroupRule deleted: 04f15b7f-02d9-4f96-9961-f83091132a69 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:34.354781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (04f15b7f-02d9-4f96-9961-f83091132a69), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:34.355322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Security group rule updated ['8d4e5401-3d21-457d-b9fd-5708c624638c'] Sep 27 04:21:34.355963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Resource SecurityGroupRule deleted: 55a9ee07-3981-4251-9c37-a8edac696841 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:34.356498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (55a9ee07-3981-4251-9c37-a8edac696841), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:34.358243 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Security group rule updated ['8d4e5401-3d21-457d-b9fd-5708c624638c'] Sep 27 04:21:34.358876 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Resource SecurityGroupRule deleted: 6f268e03-009f-45ab-a41f-26477816f8b6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:34.363593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6f268e03-009f-45ab-a41f-26477816f8b6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:34.364036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Security group rule updated ['8d4e5401-3d21-457d-b9fd-5708c624638c'] Sep 27 04:21:34.364714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Resource SecurityGroupRule deleted: 87119c71-372a-4142-a2cd-fbfb03d5320b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:34.364921 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (87119c71-372a-4142-a2cd-fbfb03d5320b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:34.365319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-446e51f7-b45c-4bdf-87d9-c3133db8f380 admin admin] Security group rule updated ['8d4e5401-3d21-457d-b9fd-5708c624638c'] Sep 27 04:21:35.516584 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:286 started Sep 27 04:21:35.520371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c55,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=344000000,duration_sec=585,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:35.521147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:35.521659 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:286 - starting polling. Elapsed:0.005 Sep 27 04:21:35.525889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:35.530857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:286 - port information retrieved. Elapsed:0.014 Sep 27 04:21:35.531379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:286 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 27 04:21:35.667160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b0f3948b-c804-4958-9c96-5fefbd31faea updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:35.668662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b0f3948b-c804-4958-9c96-5fefbd31faea), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:37.517612 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:287 started Sep 27 04:21:37.520488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c57,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=344000000,duration_sec=587,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:37.521070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:37.521432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:287 - starting polling. Elapsed:0.004 Sep 27 04:21:37.523989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:37.527430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:287 - port information retrieved. Elapsed:0.010 Sep 27 04:21:37.527761 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:287 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:21:38.940433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b0f3948b-c804-4958-9c96-5fefbd31faea updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:38.941507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b0f3948b-c804-4958-9c96-5fefbd31faea), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:39.518274 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:288 started Sep 27 04:21:39.523474 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c59,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=346000000,duration_sec=589,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:39.525538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:39.527686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:288 - starting polling. Elapsed:0.008 Sep 27 04:21:39.532725 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:39.557210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:288 - port information retrieved. Elapsed:0.034 Sep 27 04:21:39.558668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:288 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.041 Sep 27 04:21:41.520682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:289 started Sep 27 04:21:41.525983 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=348000000,duration_sec=591,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:41.527095 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:41.527749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:289 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 27 04:21:41.834312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:41Z,description='Default security group',id=83e0d08b-866e-4555-8dfe-cd20328d6ca9,is_default=True,name='default',project_id='118a051914be4932887e976dab9efdf5',revision_number=1,rules=[SecurityGroupRule(adc3b29e-adcc-4993-95ef-fdccc92443c7),SecurityGroupRule(bccc2722-59d9-45a2-a296-63fc66825729),SecurityGroupRule(ce1bbce1-8dec-4be8-bb7a-59b8e641c35f),SecurityGroupRule(cf3df9f2-a8f9-4e03-9fe4-a5e801082bbf)],shared=False,stateful=True,updated_at=2022-09-27T04:21:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:41.837349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (83e0d08b-866e-4555-8dfe-cd20328d6ca9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:41.841370 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:41Z,description=,direction='ingress',ethertype='IPv4',id=adc3b29e-adcc-4993-95ef-fdccc92443c7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='118a051914be4932887e976dab9efdf5',protocol=,remote_address_group_id=,remote_group_id=83e0d08b-866e-4555-8dfe-cd20328d6ca9,remote_ip_prefix=,revision_number=0,security_group_id=83e0d08b-866e-4555-8dfe-cd20328d6ca9,updated_at=2022-09-27T04:21:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:41.842052 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (adc3b29e-adcc-4993-95ef-fdccc92443c7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:41.843552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Security group rule updated ['83e0d08b-866e-4555-8dfe-cd20328d6ca9'] Sep 27 04:21:41.846929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:41Z,description=,direction='ingress',ethertype='IPv6',id=bccc2722-59d9-45a2-a296-63fc66825729,normalized_cidr=None,port_range_max=,port_range_min=,project_id='118a051914be4932887e976dab9efdf5',protocol=,remote_address_group_id=,remote_group_id=83e0d08b-866e-4555-8dfe-cd20328d6ca9,remote_ip_prefix=,revision_number=0,security_group_id=83e0d08b-866e-4555-8dfe-cd20328d6ca9,updated_at=2022-09-27T04:21:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:41.849821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (bccc2722-59d9-45a2-a296-63fc66825729), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:41.850193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Security group rule updated ['83e0d08b-866e-4555-8dfe-cd20328d6ca9'] Sep 27 04:21:41.854415 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:41Z,description=,direction='egress',ethertype='IPv6',id=ce1bbce1-8dec-4be8-bb7a-59b8e641c35f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='118a051914be4932887e976dab9efdf5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=83e0d08b-866e-4555-8dfe-cd20328d6ca9,updated_at=2022-09-27T04:21:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:41.856015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ce1bbce1-8dec-4be8-bb7a-59b8e641c35f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:41.857965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Security group rule updated ['83e0d08b-866e-4555-8dfe-cd20328d6ca9'] Sep 27 04:21:41.858882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:41Z,description=,direction='egress',ethertype='IPv4',id=cf3df9f2-a8f9-4e03-9fe4-a5e801082bbf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='118a051914be4932887e976dab9efdf5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=83e0d08b-866e-4555-8dfe-cd20328d6ca9,updated_at=2022-09-27T04:21:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:41.859256 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cf3df9f2-a8f9-4e03-9fe4-a5e801082bbf), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:41.861068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c485e5a-2d63-4ba0-9588-4e5e3ec05eff admin admin] Security group rule updated ['83e0d08b-866e-4555-8dfe-cd20328d6ca9'] Sep 27 04:21:42.061103 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Resource SecurityGroup deleted: 83e0d08b-866e-4555-8dfe-cd20328d6ca9 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:42.062015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (83e0d08b-866e-4555-8dfe-cd20328d6ca9), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:42.062479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('83e0d08b-866e-4555-8dfe-cd20328d6ca9',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:42.079269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('83e0d08b-866e-4555-8dfe-cd20328d6ca9',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:42.079930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Resource SecurityGroupRule deleted: adc3b29e-adcc-4993-95ef-fdccc92443c7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:42.080486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (adc3b29e-adcc-4993-95ef-fdccc92443c7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:42.081043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Security group rule updated ['83e0d08b-866e-4555-8dfe-cd20328d6ca9'] Sep 27 04:21:42.081675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Resource SecurityGroupRule deleted: bccc2722-59d9-45a2-a296-63fc66825729 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:42.082818 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (bccc2722-59d9-45a2-a296-63fc66825729), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:42.084039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Security group rule updated ['83e0d08b-866e-4555-8dfe-cd20328d6ca9'] Sep 27 04:21:42.084684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Resource SecurityGroupRule deleted: ce1bbce1-8dec-4be8-bb7a-59b8e641c35f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:42.085167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ce1bbce1-8dec-4be8-bb7a-59b8e641c35f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:42.085628 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Security group rule updated ['83e0d08b-866e-4555-8dfe-cd20328d6ca9'] Sep 27 04:21:42.086359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Resource SecurityGroupRule deleted: cf3df9f2-a8f9-4e03-9fe4-a5e801082bbf {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:42.086848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cf3df9f2-a8f9-4e03-9fe4-a5e801082bbf), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:42.087305 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d611ed90-bf2d-4380-bfe2-de013b35da55 admin admin] Security group rule updated ['83e0d08b-866e-4555-8dfe-cd20328d6ca9'] Sep 27 04:21:43.320741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:43Z,description='Default security group',id=31b26620-a24b-4460-9a83-4151d3e45dd4,is_default=True,name='default',project_id='988a2e4b6d154a4da1ee1a1f4d696588',revision_number=1,rules=[SecurityGroupRule(09b52cbb-75e8-41dc-88a6-edd9c2aff166),SecurityGroupRule(52d77ab3-a9f0-4aaa-913e-4e7e1024d20f),SecurityGroupRule(53c5d239-10d2-4e02-b51d-c360d91abb76),SecurityGroupRule(b3d7badc-40af-466d-b41b-92a8ba6ad5f8)],shared=False,stateful=True,updated_at=2022-09-27T04:21:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:43.321857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (31b26620-a24b-4460-9a83-4151d3e45dd4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:43.322652 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:43Z,description=,direction='ingress',ethertype='IPv6',id=09b52cbb-75e8-41dc-88a6-edd9c2aff166,normalized_cidr=None,port_range_max=,port_range_min=,project_id='988a2e4b6d154a4da1ee1a1f4d696588',protocol=,remote_address_group_id=,remote_group_id=31b26620-a24b-4460-9a83-4151d3e45dd4,remote_ip_prefix=,revision_number=0,security_group_id=31b26620-a24b-4460-9a83-4151d3e45dd4,updated_at=2022-09-27T04:21:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:43.323463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (09b52cbb-75e8-41dc-88a6-edd9c2aff166), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:43.324048 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Security group rule updated ['31b26620-a24b-4460-9a83-4151d3e45dd4'] Sep 27 04:21:43.324921 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:43Z,description=,direction='ingress',ethertype='IPv4',id=52d77ab3-a9f0-4aaa-913e-4e7e1024d20f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='988a2e4b6d154a4da1ee1a1f4d696588',protocol=,remote_address_group_id=,remote_group_id=31b26620-a24b-4460-9a83-4151d3e45dd4,remote_ip_prefix=,revision_number=0,security_group_id=31b26620-a24b-4460-9a83-4151d3e45dd4,updated_at=2022-09-27T04:21:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:43.325488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (52d77ab3-a9f0-4aaa-913e-4e7e1024d20f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:43.326151 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Security group rule updated ['31b26620-a24b-4460-9a83-4151d3e45dd4'] Sep 27 04:21:43.326942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:43Z,description=,direction='egress',ethertype='IPv4',id=53c5d239-10d2-4e02-b51d-c360d91abb76,normalized_cidr=None,port_range_max=,port_range_min=,project_id='988a2e4b6d154a4da1ee1a1f4d696588',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=31b26620-a24b-4460-9a83-4151d3e45dd4,updated_at=2022-09-27T04:21:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:43.329585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (53c5d239-10d2-4e02-b51d-c360d91abb76), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:43.330093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Security group rule updated ['31b26620-a24b-4460-9a83-4151d3e45dd4'] Sep 27 04:21:43.330890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:43Z,description=,direction='egress',ethertype='IPv6',id=b3d7badc-40af-466d-b41b-92a8ba6ad5f8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='988a2e4b6d154a4da1ee1a1f4d696588',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=31b26620-a24b-4460-9a83-4151d3e45dd4,updated_at=2022-09-27T04:21:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:43.331360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b3d7badc-40af-466d-b41b-92a8ba6ad5f8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:43.332331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Security group rule updated ['31b26620-a24b-4460-9a83-4151d3e45dd4'] Sep 27 04:21:43.522031 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:290 started Sep 27 04:21:43.525041 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c5d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=349000000,duration_sec=593,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:43.525936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:43.526459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:290 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:21:43.808680 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:43Z,data_plane_status=None,description='',device_id='15636443-a500-413b-ada7-f5af04e71e1c',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5bc8f02a-52ca-41b8-b099-9368fd516a45,mac_address=fa:16:3e:37:2a:cd,name='',network_id=1659662c-84cd-4ca0-9418-f36b497121ac,numa_affinity_policy=,project_id='988a2e4b6d154a4da1ee1a1f4d696588',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5bc8f02a-52ca-41b8-b099-9368fd516a45),security_group_ids=set([31b26620-a24b-4460-9a83-4151d3e45dd4]),status='DOWN',updated_at=2022-09-27T04:21:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:43.809354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (5bc8f02a-52ca-41b8-b099-9368fd516a45), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:43.810146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-01571398-3b35-494b-9c7f-0bb8fe87afa8 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Security group member updated {'31b26620-a24b-4460-9a83-4151d3e45dd4'} Sep 27 04:21:45.523308 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:291 started Sep 27 04:21:45.525735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=350000000,duration_sec=595,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:45.526348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:45.526684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:291 - starting polling. Elapsed:0.004 Sep 27 04:21:45.529204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:45.533398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:291 - port information retrieved. Elapsed:0.010 Sep 27 04:21:45.533732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:291 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:21:46.541252 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8d58186a-fbd8-413e-9d6a-b83095611655 service neutron] Resource Port 5bc8f02a-52ca-41b8-b099-9368fd516a45 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=5bc8f02a-52ca-41b8-b099-9368fd516a45,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=5bc8f02a-52ca-41b8-b099-9368fd516a45,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:46.541941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8d58186a-fbd8-413e-9d6a-b83095611655 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (5bc8f02a-52ca-41b8-b099-9368fd516a45), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:46.976134 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8d58186a-fbd8-413e-9d6a-b83095611655 service neutron] Resource Port 5bc8f02a-52ca-41b8-b099-9368fd516a45 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=5bc8f02a-52ca-41b8-b099-9368fd516a45,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=5bc8f02a-52ca-41b8-b099-9368fd516a45,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=5bc8f02a-52ca-41b8-b099-9368fd516a45,segment=NetworkSegment(9fed9611-888f-4522-acf6-4e174e3e22fb),segment_id=9fed9611-888f-4522-acf6-4e174e3e22fb)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:46.976521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8d58186a-fbd8-413e-9d6a-b83095611655 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (5bc8f02a-52ca-41b8-b099-9368fd516a45), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:47.524759 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:292 started Sep 27 04:21:47.527356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c61,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=352000000,duration_sec=597,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:47.528004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:47.528406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:292 - starting polling. Elapsed:0.004 Sep 27 04:21:47.531389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:47.537710 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:292 - port information retrieved. Elapsed:0.011 Sep 27 04:21:47.537710 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:292 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:21:48.134326 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78300cef-5b1f-4cbf-a302-b09c751ad90b tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:21:47Z,data_plane_status=None,description='',device_id='c7036d25-7161-4e1f-95a5-5c8549139bc3',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9d990fa5-a24c-4b14-8c63-0e0506b80887,mac_address=fa:16:3e:64:78:c2,name='',network_id=8bc82a56-69c2-484f-aa08-23831b7e71a2,numa_affinity_policy=,project_id='7e7b2ff0f0104769a550d0c0692ab713',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9d990fa5-a24c-4b14-8c63-0e0506b80887),security_group_ids=set([2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66]),status='DOWN',updated_at=2022-09-27T04:21:47Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:48.134889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78300cef-5b1f-4cbf-a302-b09c751ad90b tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9d990fa5-a24c-4b14-8c63-0e0506b80887), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:48.135167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78300cef-5b1f-4cbf-a302-b09c751ad90b tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group member updated {'2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'} Sep 27 04:21:49.529731 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:293 started Sep 27 04:21:49.533518 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=357000000,duration_sec=599,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:49.533689 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:49.534103 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:293 - starting polling. Elapsed:0.008 Sep 27 04:21:49.538756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.542282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:293 - port information retrieved. Elapsed:0.017 Sep 27 04:21:49.547140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:293 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 27 04:21:49.593394 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:49Z,description='Default security group',id=de67eae4-82f4-42a0-a907-7f2dcb494468,is_default=True,name='default',project_id='8ef89153c2d24ff99040819c56e54e8c',revision_number=1,rules=[SecurityGroupRule(6044ec09-5b27-4cb6-8f63-ca7c2687eccb),SecurityGroupRule(738f2da3-036f-434e-aaeb-fd16056a8f0d),SecurityGroupRule(7b854a30-af8a-4f73-995e-db33a79c218c),SecurityGroupRule(fe909ed1-8f92-4978-b633-75a23dc5b2f9)],shared=False,stateful=True,updated_at=2022-09-27T04:21:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:49.594130 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (de67eae4-82f4-42a0-a907-7f2dcb494468), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.594991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:49Z,description=,direction='ingress',ethertype='IPv6',id=6044ec09-5b27-4cb6-8f63-ca7c2687eccb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ef89153c2d24ff99040819c56e54e8c',protocol=,remote_address_group_id=,remote_group_id=de67eae4-82f4-42a0-a907-7f2dcb494468,remote_ip_prefix=,revision_number=0,security_group_id=de67eae4-82f4-42a0-a907-7f2dcb494468,updated_at=2022-09-27T04:21:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:49.595566 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6044ec09-5b27-4cb6-8f63-ca7c2687eccb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.596295 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Security group rule updated ['de67eae4-82f4-42a0-a907-7f2dcb494468'] Sep 27 04:21:49.597377 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:49Z,description=,direction='ingress',ethertype='IPv4',id=738f2da3-036f-434e-aaeb-fd16056a8f0d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ef89153c2d24ff99040819c56e54e8c',protocol=,remote_address_group_id=,remote_group_id=de67eae4-82f4-42a0-a907-7f2dcb494468,remote_ip_prefix=,revision_number=0,security_group_id=de67eae4-82f4-42a0-a907-7f2dcb494468,updated_at=2022-09-27T04:21:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:49.598053 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (738f2da3-036f-434e-aaeb-fd16056a8f0d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.598436 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Security group rule updated ['de67eae4-82f4-42a0-a907-7f2dcb494468'] Sep 27 04:21:49.599307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:49Z,description=,direction='egress',ethertype='IPv4',id=7b854a30-af8a-4f73-995e-db33a79c218c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ef89153c2d24ff99040819c56e54e8c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de67eae4-82f4-42a0-a907-7f2dcb494468,updated_at=2022-09-27T04:21:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:49.599740 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7b854a30-af8a-4f73-995e-db33a79c218c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.600075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Security group rule updated ['de67eae4-82f4-42a0-a907-7f2dcb494468'] Sep 27 04:21:49.601445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:49Z,description=,direction='egress',ethertype='IPv6',id=fe909ed1-8f92-4978-b633-75a23dc5b2f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ef89153c2d24ff99040819c56e54e8c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de67eae4-82f4-42a0-a907-7f2dcb494468,updated_at=2022-09-27T04:21:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:49.615460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (fe909ed1-8f92-4978-b633-75a23dc5b2f9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.615460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bf65c5e6-3573-4a6e-82b0-ac95edda8c1e admin admin] Security group rule updated ['de67eae4-82f4-42a0-a907-7f2dcb494468'] Sep 27 04:21:49.789562 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:49Z,description='Default security group',id=7e9f64c1-90c9-46aa-899b-ef784c4525eb,is_default=True,name='default',project_id='cd836c63e9f14336a59ea9d51b05510b',revision_number=1,rules=[SecurityGroupRule(20de7388-da68-464d-a3b6-f93f67407600),SecurityGroupRule(9dc66f4c-9e1e-40aa-98d4-1e79342cc031),SecurityGroupRule(e4b87f8e-f05f-4104-b4a3-2bc80a5529d6),SecurityGroupRule(e9ba9aac-f746-40f2-9202-fbfd92c5c4ce)],shared=False,stateful=True,updated_at=2022-09-27T04:21:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:49.790221 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (7e9f64c1-90c9-46aa-899b-ef784c4525eb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.791007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:49Z,description=,direction='ingress',ethertype='IPv4',id=20de7388-da68-464d-a3b6-f93f67407600,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd836c63e9f14336a59ea9d51b05510b',protocol=,remote_address_group_id=,remote_group_id=7e9f64c1-90c9-46aa-899b-ef784c4525eb,remote_ip_prefix=,revision_number=0,security_group_id=7e9f64c1-90c9-46aa-899b-ef784c4525eb,updated_at=2022-09-27T04:21:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:49.791380 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (20de7388-da68-464d-a3b6-f93f67407600), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.791764 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Security group rule updated ['7e9f64c1-90c9-46aa-899b-ef784c4525eb'] Sep 27 04:21:49.792447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:49Z,description=,direction='ingress',ethertype='IPv6',id=9dc66f4c-9e1e-40aa-98d4-1e79342cc031,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd836c63e9f14336a59ea9d51b05510b',protocol=,remote_address_group_id=,remote_group_id=7e9f64c1-90c9-46aa-899b-ef784c4525eb,remote_ip_prefix=,revision_number=0,security_group_id=7e9f64c1-90c9-46aa-899b-ef784c4525eb,updated_at=2022-09-27T04:21:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:49.792998 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9dc66f4c-9e1e-40aa-98d4-1e79342cc031), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.793320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Security group rule updated ['7e9f64c1-90c9-46aa-899b-ef784c4525eb'] Sep 27 04:21:49.794147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:49Z,description=,direction='egress',ethertype='IPv4',id=e4b87f8e-f05f-4104-b4a3-2bc80a5529d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd836c63e9f14336a59ea9d51b05510b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7e9f64c1-90c9-46aa-899b-ef784c4525eb,updated_at=2022-09-27T04:21:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:49.794668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e4b87f8e-f05f-4104-b4a3-2bc80a5529d6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.795150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Security group rule updated ['7e9f64c1-90c9-46aa-899b-ef784c4525eb'] Sep 27 04:21:49.801897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:49Z,description=,direction='egress',ethertype='IPv6',id=e9ba9aac-f746-40f2-9202-fbfd92c5c4ce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd836c63e9f14336a59ea9d51b05510b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7e9f64c1-90c9-46aa-899b-ef784c4525eb,updated_at=2022-09-27T04:21:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:49.802576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e9ba9aac-f746-40f2-9202-fbfd92c5c4ce), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.807363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-16859597-b091-4a68-99c2-093cb6a813b0 admin admin] Security group rule updated ['7e9f64c1-90c9-46aa-899b-ef784c4525eb'] Sep 27 04:21:49.948916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Resource SecurityGroup deleted: de67eae4-82f4-42a0-a907-7f2dcb494468 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:49.949931 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (de67eae4-82f4-42a0-a907-7f2dcb494468), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:49.950635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('de67eae4-82f4-42a0-a907-7f2dcb494468',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:50.012045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('de67eae4-82f4-42a0-a907-7f2dcb494468',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:50.012568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Resource SecurityGroupRule deleted: 6044ec09-5b27-4cb6-8f63-ca7c2687eccb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:50.012938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6044ec09-5b27-4cb6-8f63-ca7c2687eccb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:50.013271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Security group rule updated ['de67eae4-82f4-42a0-a907-7f2dcb494468'] Sep 27 04:21:50.013666 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Resource SecurityGroupRule deleted: 738f2da3-036f-434e-aaeb-fd16056a8f0d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:50.014032 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (738f2da3-036f-434e-aaeb-fd16056a8f0d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:50.014732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Security group rule updated ['de67eae4-82f4-42a0-a907-7f2dcb494468'] Sep 27 04:21:50.015531 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Resource SecurityGroupRule deleted: 7b854a30-af8a-4f73-995e-db33a79c218c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:50.016281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7b854a30-af8a-4f73-995e-db33a79c218c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:50.016755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Security group rule updated ['de67eae4-82f4-42a0-a907-7f2dcb494468'] Sep 27 04:21:50.017564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Resource SecurityGroupRule deleted: fe909ed1-8f92-4978-b633-75a23dc5b2f9 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:50.018092 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (fe909ed1-8f92-4978-b633-75a23dc5b2f9), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:50.018556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d9caa3d8-2347-484f-9492-1c0d47556bfa admin admin] Security group rule updated ['de67eae4-82f4-42a0-a907-7f2dcb494468'] Sep 27 04:21:50.214071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Resource SecurityGroup deleted: 7e9f64c1-90c9-46aa-899b-ef784c4525eb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:50.215314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (7e9f64c1-90c9-46aa-899b-ef784c4525eb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:50.215798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7e9f64c1-90c9-46aa-899b-ef784c4525eb',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:50.333721 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7e9f64c1-90c9-46aa-899b-ef784c4525eb',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:50.334693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Resource SecurityGroupRule deleted: 20de7388-da68-464d-a3b6-f93f67407600 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:50.335167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (20de7388-da68-464d-a3b6-f93f67407600), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:50.335607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Security group rule updated ['7e9f64c1-90c9-46aa-899b-ef784c4525eb'] Sep 27 04:21:50.336272 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Resource SecurityGroupRule deleted: 9dc66f4c-9e1e-40aa-98d4-1e79342cc031 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:50.336858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9dc66f4c-9e1e-40aa-98d4-1e79342cc031), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:50.337282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Security group rule updated ['7e9f64c1-90c9-46aa-899b-ef784c4525eb'] Sep 27 04:21:50.338002 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Resource SecurityGroupRule deleted: e4b87f8e-f05f-4104-b4a3-2bc80a5529d6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:50.338476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e4b87f8e-f05f-4104-b4a3-2bc80a5529d6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:50.339037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Security group rule updated ['7e9f64c1-90c9-46aa-899b-ef784c4525eb'] Sep 27 04:21:50.339738 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Resource SecurityGroupRule deleted: e9ba9aac-f746-40f2-9202-fbfd92c5c4ce {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:50.340198 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e9ba9aac-f746-40f2-9202-fbfd92c5c4ce), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:50.340838 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c7d4d1f5-c357-49ef-a54a-e2959df98581 admin admin] Security group rule updated ['7e9f64c1-90c9-46aa-899b-ef784c4525eb'] Sep 27 04:21:50.472683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 5bc8f02a-52ca-41b8-b099-9368fd516a45 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:50.473833 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (5bc8f02a-52ca-41b8-b099-9368fd516a45), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:51.531609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:294 started Sep 27 04:21:51.539819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c65,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=360000000,duration_sec=601,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:51.540686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:51.541187 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:294 - starting polling. Elapsed:0.010 Sep 27 04:21:51.546653 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:51.555402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:294 - port information retrieved. Elapsed:0.024 Sep 27 04:21:51.555751 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:294 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.024 Sep 27 04:21:51.687263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:50Z,description='Default security group',id=0f2e33f6-6814-4e23-9c48-f8b7ea0462bd,is_default=True,name='default',project_id='7de4e6ebc0554132a6ad5ee20c9c44d6',revision_number=1,rules=[SecurityGroupRule(03019190-2bed-4f26-8699-8adb66b2fdfe),SecurityGroupRule(1b9b04b6-4cf9-415c-88e3-a0b2b5d9b642),SecurityGroupRule(1eb143c9-3b92-461c-b735-658207089093),SecurityGroupRule(61c07778-de40-447d-90c3-13b38801921d)],shared=False,stateful=True,updated_at=2022-09-27T04:21:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:51.688321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (0f2e33f6-6814-4e23-9c48-f8b7ea0462bd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:51.688985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:50Z,description=,direction='egress',ethertype='IPv4',id=03019190-2bed-4f26-8699-8adb66b2fdfe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7de4e6ebc0554132a6ad5ee20c9c44d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0f2e33f6-6814-4e23-9c48-f8b7ea0462bd,updated_at=2022-09-27T04:21:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:51.689359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (03019190-2bed-4f26-8699-8adb66b2fdfe), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:51.689831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Security group rule updated ['0f2e33f6-6814-4e23-9c48-f8b7ea0462bd'] Sep 27 04:21:51.690686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:51Z,description=,direction='egress',ethertype='IPv6',id=1b9b04b6-4cf9-415c-88e3-a0b2b5d9b642,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7de4e6ebc0554132a6ad5ee20c9c44d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0f2e33f6-6814-4e23-9c48-f8b7ea0462bd,updated_at=2022-09-27T04:21:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:51.691039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1b9b04b6-4cf9-415c-88e3-a0b2b5d9b642), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:51.691389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Security group rule updated ['0f2e33f6-6814-4e23-9c48-f8b7ea0462bd'] Sep 27 04:21:51.692160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:51Z,description=,direction='ingress',ethertype='IPv6',id=1eb143c9-3b92-461c-b735-658207089093,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7de4e6ebc0554132a6ad5ee20c9c44d6',protocol=,remote_address_group_id=,remote_group_id=0f2e33f6-6814-4e23-9c48-f8b7ea0462bd,remote_ip_prefix=,revision_number=0,security_group_id=0f2e33f6-6814-4e23-9c48-f8b7ea0462bd,updated_at=2022-09-27T04:21:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:51.693803 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1eb143c9-3b92-461c-b735-658207089093), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:51.694164 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Security group rule updated ['0f2e33f6-6814-4e23-9c48-f8b7ea0462bd'] Sep 27 04:21:51.701139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:50Z,description=,direction='ingress',ethertype='IPv4',id=61c07778-de40-447d-90c3-13b38801921d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7de4e6ebc0554132a6ad5ee20c9c44d6',protocol=,remote_address_group_id=,remote_group_id=0f2e33f6-6814-4e23-9c48-f8b7ea0462bd,remote_ip_prefix=,revision_number=0,security_group_id=0f2e33f6-6814-4e23-9c48-f8b7ea0462bd,updated_at=2022-09-27T04:21:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:51.701735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (61c07778-de40-447d-90c3-13b38801921d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:51.702153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a59e0dae-a5ea-4809-a5d0-0f6ae5ea3abc admin admin] Security group rule updated ['0f2e33f6-6814-4e23-9c48-f8b7ea0462bd'] Sep 27 04:21:52.506194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Resource SecurityGroup deleted: 0f2e33f6-6814-4e23-9c48-f8b7ea0462bd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:52.506710 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (0f2e33f6-6814-4e23-9c48-f8b7ea0462bd), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:52.507278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0f2e33f6-6814-4e23-9c48-f8b7ea0462bd',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:52.666948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0f2e33f6-6814-4e23-9c48-f8b7ea0462bd',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:52.668267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Resource SecurityGroupRule deleted: 03019190-2bed-4f26-8699-8adb66b2fdfe {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:52.668865 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (03019190-2bed-4f26-8699-8adb66b2fdfe), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:52.669386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Security group rule updated ['0f2e33f6-6814-4e23-9c48-f8b7ea0462bd'] Sep 27 04:21:52.670254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Resource SecurityGroupRule deleted: 1b9b04b6-4cf9-415c-88e3-a0b2b5d9b642 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:52.670812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1b9b04b6-4cf9-415c-88e3-a0b2b5d9b642), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:52.671526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Security group rule updated ['0f2e33f6-6814-4e23-9c48-f8b7ea0462bd'] Sep 27 04:21:52.672148 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Resource SecurityGroupRule deleted: 1eb143c9-3b92-461c-b735-658207089093 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:52.673004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1eb143c9-3b92-461c-b735-658207089093), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:52.673528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Security group rule updated ['0f2e33f6-6814-4e23-9c48-f8b7ea0462bd'] Sep 27 04:21:52.674305 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Resource SecurityGroupRule deleted: 61c07778-de40-447d-90c3-13b38801921d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:52.675244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (61c07778-de40-447d-90c3-13b38801921d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:52.676166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b5a403a3-0a69-449d-8d9d-c3bca33b5ff3 admin admin] Security group rule updated ['0f2e33f6-6814-4e23-9c48-f8b7ea0462bd'] Sep 27 04:21:52.853729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 5bc8f02a-52ca-41b8-b099-9368fd516a45 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:52.854941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (5bc8f02a-52ca-41b8-b099-9368fd516a45), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:52.976184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f7ccb789-d1fb-46b4-a6e9-f9a91a8dccd1 service neutron] Resource Port 9d990fa5-a24c-4b14-8c63-0e0506b80887 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=9d990fa5-a24c-4b14-8c63-0e0506b80887,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=9d990fa5-a24c-4b14-8c63-0e0506b80887,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:52.977437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f7ccb789-d1fb-46b4-a6e9-f9a91a8dccd1 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9d990fa5-a24c-4b14-8c63-0e0506b80887), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.364566 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:53Z,description='Default security group',id=f19d9390-380b-49d3-b80c-e8443229f861,is_default=True,name='default',project_id='5ada2c71f3c948f58cec85e4edaf1a92',revision_number=1,rules=[SecurityGroupRule(2f383c07-08ed-40b0-bce2-8df88c032eb1),SecurityGroupRule(425b5fc0-8cac-4b42-a5b1-365003dddd35),SecurityGroupRule(4f193a77-b02b-4838-9661-4952bb6be472),SecurityGroupRule(88d58046-d9fe-49c4-b5bf-38d4cdd1b572)],shared=False,stateful=True,updated_at=2022-09-27T04:21:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:53.365321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (f19d9390-380b-49d3-b80c-e8443229f861), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.366499 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:53Z,description=,direction='ingress',ethertype='IPv6',id=2f383c07-08ed-40b0-bce2-8df88c032eb1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ada2c71f3c948f58cec85e4edaf1a92',protocol=,remote_address_group_id=,remote_group_id=f19d9390-380b-49d3-b80c-e8443229f861,remote_ip_prefix=,revision_number=0,security_group_id=f19d9390-380b-49d3-b80c-e8443229f861,updated_at=2022-09-27T04:21:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:53.366956 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2f383c07-08ed-40b0-bce2-8df88c032eb1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.367407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Security group rule updated ['f19d9390-380b-49d3-b80c-e8443229f861'] Sep 27 04:21:53.368206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:53Z,description=,direction='egress',ethertype='IPv4',id=425b5fc0-8cac-4b42-a5b1-365003dddd35,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ada2c71f3c948f58cec85e4edaf1a92',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f19d9390-380b-49d3-b80c-e8443229f861,updated_at=2022-09-27T04:21:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:53.368817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (425b5fc0-8cac-4b42-a5b1-365003dddd35), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.370503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Security group rule updated ['f19d9390-380b-49d3-b80c-e8443229f861'] Sep 27 04:21:53.371538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:53Z,description=,direction='ingress',ethertype='IPv4',id=4f193a77-b02b-4838-9661-4952bb6be472,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ada2c71f3c948f58cec85e4edaf1a92',protocol=,remote_address_group_id=,remote_group_id=f19d9390-380b-49d3-b80c-e8443229f861,remote_ip_prefix=,revision_number=0,security_group_id=f19d9390-380b-49d3-b80c-e8443229f861,updated_at=2022-09-27T04:21:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:53.372211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4f193a77-b02b-4838-9661-4952bb6be472), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.374630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Security group rule updated ['f19d9390-380b-49d3-b80c-e8443229f861'] Sep 27 04:21:53.377281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:53Z,description=,direction='egress',ethertype='IPv6',id=88d58046-d9fe-49c4-b5bf-38d4cdd1b572,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ada2c71f3c948f58cec85e4edaf1a92',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f19d9390-380b-49d3-b80c-e8443229f861,updated_at=2022-09-27T04:21:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:53.379302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (88d58046-d9fe-49c4-b5bf-38d4cdd1b572), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.380911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1b49c3d4-db17-4d4b-a310-f84bbce48a03 admin admin] Security group rule updated ['f19d9390-380b-49d3-b80c-e8443229f861'] Sep 27 04:21:53.533372 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:295 started Sep 27 04:21:53.538771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=361000000,duration_sec=603,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:53.539970 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:53.540658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:295 - starting polling. Elapsed:0.008 Sep 27 04:21:53.547888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.566280 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:295 - port information retrieved. Elapsed:0.033 Sep 27 04:21:53.567643 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:295 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.034 Sep 27 04:21:53.927080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:53Z,description='Default security group',id=c1625d45-ef42-4c27-945b-33de89a885e9,is_default=True,name='default',project_id='cb383707cc014e58ad6685429e2f3388',revision_number=1,rules=[SecurityGroupRule(91835353-9fd5-421a-bac6-6760036da4b1),SecurityGroupRule(a8c9664e-b159-4ca3-bbd1-2e21e6f399b6),SecurityGroupRule(d7f7d4d2-94b7-4ba8-85ab-fb89e3a11c2e),SecurityGroupRule(ee7ebfc3-ea10-4cce-a259-bcb9b264b0f2)],shared=False,stateful=True,updated_at=2022-09-27T04:21:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:53.927776 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (c1625d45-ef42-4c27-945b-33de89a885e9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.928735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:53Z,description=,direction='ingress',ethertype='IPv4',id=91835353-9fd5-421a-bac6-6760036da4b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb383707cc014e58ad6685429e2f3388',protocol=,remote_address_group_id=,remote_group_id=c1625d45-ef42-4c27-945b-33de89a885e9,remote_ip_prefix=,revision_number=0,security_group_id=c1625d45-ef42-4c27-945b-33de89a885e9,updated_at=2022-09-27T04:21:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:53.929174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (91835353-9fd5-421a-bac6-6760036da4b1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.929526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Security group rule updated ['c1625d45-ef42-4c27-945b-33de89a885e9'] Sep 27 04:21:53.930604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:53Z,description=,direction='egress',ethertype='IPv6',id=a8c9664e-b159-4ca3-bbd1-2e21e6f399b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb383707cc014e58ad6685429e2f3388',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c1625d45-ef42-4c27-945b-33de89a885e9,updated_at=2022-09-27T04:21:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:53.931186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a8c9664e-b159-4ca3-bbd1-2e21e6f399b6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.931736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Security group rule updated ['c1625d45-ef42-4c27-945b-33de89a885e9'] Sep 27 04:21:53.935301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:53Z,description=,direction='ingress',ethertype='IPv6',id=d7f7d4d2-94b7-4ba8-85ab-fb89e3a11c2e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb383707cc014e58ad6685429e2f3388',protocol=,remote_address_group_id=,remote_group_id=c1625d45-ef42-4c27-945b-33de89a885e9,remote_ip_prefix=,revision_number=0,security_group_id=c1625d45-ef42-4c27-945b-33de89a885e9,updated_at=2022-09-27T04:21:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:53.938804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d7f7d4d2-94b7-4ba8-85ab-fb89e3a11c2e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.939477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Security group rule updated ['c1625d45-ef42-4c27-945b-33de89a885e9'] Sep 27 04:21:53.941593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:53Z,description=,direction='egress',ethertype='IPv4',id=ee7ebfc3-ea10-4cce-a259-bcb9b264b0f2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb383707cc014e58ad6685429e2f3388',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c1625d45-ef42-4c27-945b-33de89a885e9,updated_at=2022-09-27T04:21:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:53.942385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ee7ebfc3-ea10-4cce-a259-bcb9b264b0f2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.943940 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78c27cbb-35a1-4be8-a1a9-b2d52f56d7d1 admin admin] Security group rule updated ['c1625d45-ef42-4c27-945b-33de89a885e9'] Sep 27 04:21:53.950857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Resource SecurityGroup deleted: f19d9390-380b-49d3-b80c-e8443229f861 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:53.952732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (f19d9390-380b-49d3-b80c-e8443229f861), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:53.954423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f19d9390-380b-49d3-b80c-e8443229f861',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:53.995633 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f7ccb789-d1fb-46b4-a6e9-f9a91a8dccd1 service neutron] Resource Port 9d990fa5-a24c-4b14-8c63-0e0506b80887 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=9d990fa5-a24c-4b14-8c63-0e0506b80887,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=9d990fa5-a24c-4b14-8c63-0e0506b80887,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=9d990fa5-a24c-4b14-8c63-0e0506b80887,segment=NetworkSegment(39fbe748-2b18-4d3a-b683-ef5d7bb2f520),segment_id=39fbe748-2b18-4d3a-b683-ef5d7bb2f520)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:21:53.996332 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f7ccb789-d1fb-46b4-a6e9-f9a91a8dccd1 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9d990fa5-a24c-4b14-8c63-0e0506b80887), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:54.028301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f19d9390-380b-49d3-b80c-e8443229f861',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:54.029124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Resource SecurityGroupRule deleted: 2f383c07-08ed-40b0-bce2-8df88c032eb1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:54.029504 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2f383c07-08ed-40b0-bce2-8df88c032eb1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:54.029878 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Security group rule updated ['f19d9390-380b-49d3-b80c-e8443229f861'] Sep 27 04:21:54.031370 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Resource SecurityGroupRule deleted: 425b5fc0-8cac-4b42-a5b1-365003dddd35 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:54.031631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (425b5fc0-8cac-4b42-a5b1-365003dddd35), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:54.031976 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Security group rule updated ['f19d9390-380b-49d3-b80c-e8443229f861'] Sep 27 04:21:54.032346 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Resource SecurityGroupRule deleted: 4f193a77-b02b-4838-9661-4952bb6be472 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:54.032699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4f193a77-b02b-4838-9661-4952bb6be472), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:54.033085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Security group rule updated ['f19d9390-380b-49d3-b80c-e8443229f861'] Sep 27 04:21:54.033642 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Resource SecurityGroupRule deleted: 88d58046-d9fe-49c4-b5bf-38d4cdd1b572 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:54.034023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (88d58046-d9fe-49c4-b5bf-38d4cdd1b572), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:54.034603 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3e67f810-c392-4214-949e-4e655b26888f admin admin] Security group rule updated ['f19d9390-380b-49d3-b80c-e8443229f861'] Sep 27 04:21:54.205349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Resource SecurityGroup deleted: c1625d45-ef42-4c27-945b-33de89a885e9 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:54.205984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (c1625d45-ef42-4c27-945b-33de89a885e9), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:54.206494 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c1625d45-ef42-4c27-945b-33de89a885e9',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:21:54.227567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c1625d45-ef42-4c27-945b-33de89a885e9',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:21:54.228260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Resource SecurityGroupRule deleted: 91835353-9fd5-421a-bac6-6760036da4b1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:54.228879 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (91835353-9fd5-421a-bac6-6760036da4b1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:54.229574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Security group rule updated ['c1625d45-ef42-4c27-945b-33de89a885e9'] Sep 27 04:21:54.230156 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Resource SecurityGroupRule deleted: a8c9664e-b159-4ca3-bbd1-2e21e6f399b6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:54.231472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a8c9664e-b159-4ca3-bbd1-2e21e6f399b6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:54.231991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Security group rule updated ['c1625d45-ef42-4c27-945b-33de89a885e9'] Sep 27 04:21:54.232527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Resource SecurityGroupRule deleted: d7f7d4d2-94b7-4ba8-85ab-fb89e3a11c2e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:54.233119 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d7f7d4d2-94b7-4ba8-85ab-fb89e3a11c2e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:54.234201 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Security group rule updated ['c1625d45-ef42-4c27-945b-33de89a885e9'] Sep 27 04:21:54.234725 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Resource SecurityGroupRule deleted: ee7ebfc3-ea10-4cce-a259-bcb9b264b0f2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:21:54.235238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ee7ebfc3-ea10-4cce-a259-bcb9b264b0f2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:54.235769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d6f18e4c-47b4-4048-912e-9c6910749587 admin admin] Security group rule updated ['c1625d45-ef42-4c27-945b-33de89a885e9'] Sep 27 04:21:55.535516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:296 started Sep 27 04:21:55.540658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c69,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=365000000,duration_sec=605,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:55.541633 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:55.542260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:296 - starting polling. Elapsed:0.007 Sep 27 04:21:55.545935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:55.550396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:296 - port information retrieved. Elapsed:0.015 Sep 27 04:21:55.551011 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:296 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 27 04:21:55.787170 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:21:55Z,description='Default security group',id=b085b3fa-48ce-47db-8026-9c8743b70349,is_default=True,name='default',project_id='14d42cf78c32468cb8bf10aa847c7cc3',revision_number=1,rules=[SecurityGroupRule(4ab72a21-2183-4d78-9718-39bad9259732),SecurityGroupRule(88bd9f2e-1a21-4715-96bd-e41f04c85614),SecurityGroupRule(89c8a702-a868-461c-8e65-6f1afd7aae16),SecurityGroupRule(e047f784-5ea2-4930-83d8-72cb31db9063)],shared=False,stateful=True,updated_at=2022-09-27T04:21:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:55.788074 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (b085b3fa-48ce-47db-8026-9c8743b70349), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:55.789923 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:55Z,description=,direction='egress',ethertype='IPv4',id=4ab72a21-2183-4d78-9718-39bad9259732,normalized_cidr=None,port_range_max=,port_range_min=,project_id='14d42cf78c32468cb8bf10aa847c7cc3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b085b3fa-48ce-47db-8026-9c8743b70349,updated_at=2022-09-27T04:21:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:55.791892 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4ab72a21-2183-4d78-9718-39bad9259732), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:55.793122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Security group rule updated ['b085b3fa-48ce-47db-8026-9c8743b70349'] Sep 27 04:21:55.797434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:55Z,description=,direction='egress',ethertype='IPv6',id=88bd9f2e-1a21-4715-96bd-e41f04c85614,normalized_cidr=None,port_range_max=,port_range_min=,project_id='14d42cf78c32468cb8bf10aa847c7cc3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b085b3fa-48ce-47db-8026-9c8743b70349,updated_at=2022-09-27T04:21:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:55.800123 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (88bd9f2e-1a21-4715-96bd-e41f04c85614), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:55.801269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Security group rule updated ['b085b3fa-48ce-47db-8026-9c8743b70349'] Sep 27 04:21:55.805237 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:55Z,description=,direction='ingress',ethertype='IPv6',id=89c8a702-a868-461c-8e65-6f1afd7aae16,normalized_cidr=None,port_range_max=,port_range_min=,project_id='14d42cf78c32468cb8bf10aa847c7cc3',protocol=,remote_address_group_id=,remote_group_id=b085b3fa-48ce-47db-8026-9c8743b70349,remote_ip_prefix=,revision_number=0,security_group_id=b085b3fa-48ce-47db-8026-9c8743b70349,updated_at=2022-09-27T04:21:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:55.807128 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (89c8a702-a868-461c-8e65-6f1afd7aae16), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:55.807877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Security group rule updated ['b085b3fa-48ce-47db-8026-9c8743b70349'] Sep 27 04:21:55.809228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:21:55Z,description=,direction='ingress',ethertype='IPv4',id=e047f784-5ea2-4930-83d8-72cb31db9063,normalized_cidr=None,port_range_max=,port_range_min=,project_id='14d42cf78c32468cb8bf10aa847c7cc3',protocol=,remote_address_group_id=,remote_group_id=b085b3fa-48ce-47db-8026-9c8743b70349,remote_ip_prefix=,revision_number=0,security_group_id=b085b3fa-48ce-47db-8026-9c8743b70349,updated_at=2022-09-27T04:21:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:55.810217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e047f784-5ea2-4930-83d8-72cb31db9063), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:55.810895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Security group rule updated ['b085b3fa-48ce-47db-8026-9c8743b70349'] Sep 27 04:21:56.007923 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:21:55Z,description='',dns_domain=None,id=14e40f69-7e37-43ea-ba44-fd89b3b60419,mtu=1500,name='tempest-VolumesSnapshotTestJSON-814185499-network',project_id='14d42cf78c32468cb8bf10aa847c7cc3',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(14e40f69-7e37-43ea-ba44-fd89b3b60419),segments=[NetworkSegment(8f76b480-d8af-4f6a-b685-392c9daa6c91)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:21:55Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:56.008400 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (14e40f69-7e37-43ea-ba44-fd89b3b60419), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-c560aa52-032f-4dad-b4c4-9c67ec631584 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 14e40f69-7e37-43ea-ba44-fd89b3b60419 with segmentation id not found. Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:21:56.433296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:21:56.434356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:21:56.434356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:21:56.434356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:21:56.434356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 14e40f69-7e37-43ea-ba44-fd89b3b60419 with segmentation id not found. Sep 27 04:21:56.434356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:21:56.715452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-18f91d7a-12f7-4f28-9fce-2171a26d4689 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(7a1c05c6-21e9-41dc-a7eb-35f2affb1911)],cidr=172.20.0.0/28,created_at=2022-09-27T04:21:56Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=5be11e2d-b115-4126-97e6-2a19ea72362d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesSnapshotTestJSON-814185499-subnet',network_id=14e40f69-7e37-43ea-ba44-fd89b3b60419,project_id='14d42cf78c32468cb8bf10aa847c7cc3',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:21:56Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:21:56.717443 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-18f91d7a-12f7-4f28-9fce-2171a26d4689 admin admin] Publish callbacks [] for Subnet (5be11e2d-b115-4126-97e6-2a19ea72362d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:21:57.536828 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:297 started Sep 27 04:21:57.539672 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c6b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=364000000,duration_sec=607,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:57.540865 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:57.541225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:297 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:21:59.538071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:298 started Sep 27 04:21:59.541138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c6d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=365000000,duration_sec=609,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:21:59.541917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:21:59.542411 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:298 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:22:01.539384 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:299 started Sep 27 04:22:01.541922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=366000000,duration_sec=611,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:01.542495 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:01.542877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:299 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:03.539988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:300 started Sep 27 04:22:03.543296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c71,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=367000000,duration_sec=613,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:03.543939 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:03.544672 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:300 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:22:05.540539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:301 started Sep 27 04:22:05.543415 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c73,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=367000000,duration_sec=615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:05.543992 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:05.544410 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:301 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:07.104181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-690e520f-a547-4f67-9637-022065318957 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Resource Port deleted: 5bc8f02a-52ca-41b8-b099-9368fd516a45 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:07.104863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-690e520f-a547-4f67-9637-022065318957 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (5bc8f02a-52ca-41b8-b099-9368fd516a45), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:07.105409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-690e520f-a547-4f67-9637-022065318957 tempest-VolumesNegativeTest-1183096272 tempest-VolumesNegativeTest-1183096272-project] Security group member updated {'31b26620-a24b-4460-9a83-4151d3e45dd4'} Sep 27 04:22:07.296484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1a75b48f-4ed3-45ef-8371-adf1ff3c737e tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:22:06Z,data_plane_status=None,description='',device_id='7ff20f8a-f72b-4c87-8c62-dbdf2714536d',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=44284c30-6edf-45a3-8b70-fc4bb36bc551,mac_address=fa:16:3e:c5:f9:60,name='',network_id=14e40f69-7e37-43ea-ba44-fd89b3b60419,numa_affinity_policy=,project_id='14d42cf78c32468cb8bf10aa847c7cc3',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(44284c30-6edf-45a3-8b70-fc4bb36bc551),security_group_ids=set([b085b3fa-48ce-47db-8026-9c8743b70349]),status='DOWN',updated_at=2022-09-27T04:22:06Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:07.296957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1a75b48f-4ed3-45ef-8371-adf1ff3c737e tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (44284c30-6edf-45a3-8b70-fc4bb36bc551), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:07.297471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1a75b48f-4ed3-45ef-8371-adf1ff3c737e tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Security group member updated {'b085b3fa-48ce-47db-8026-9c8743b70349'} Sep 27 04:22:07.541438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:302 started Sep 27 04:22:07.544225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=368000000,duration_sec=617,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:07.545035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:07.545698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:302 - starting polling. Elapsed:0.004 Sep 27 04:22:07.548743 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:07.550900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 5bc8f02a-52ca-41b8-b099-9368fd516a45 not present in bridge br-int Sep 27 04:22:07.551330 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:22:07.551760 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['5bc8f02a-52ca-41b8-b099-9368fd516a45'] Sep 27 04:22:07.552235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 5bc8f02a-52ca-41b8-b099-9368fd516a45 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:22:07.555979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:302 - port information retrieved. Elapsed:0.015 Sep 27 04:22:07.556397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:302 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 27 04:22:08.151302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 9d990fa5-a24c-4b14-8c63-0e0506b80887 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:08.151953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9d990fa5-a24c-4b14-8c63-0e0506b80887), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:08.540079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30e369ef-1f2a-4fd6-b564-80b3bd3ef671 service neutron] Resource Port 44284c30-6edf-45a3-8b70-fc4bb36bc551 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=44284c30-6edf-45a3-8b70-fc4bb36bc551,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=44284c30-6edf-45a3-8b70-fc4bb36bc551,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:08.540461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30e369ef-1f2a-4fd6-b564-80b3bd3ef671 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (44284c30-6edf-45a3-8b70-fc4bb36bc551), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:08.964960 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30e369ef-1f2a-4fd6-b564-80b3bd3ef671 service neutron] Resource Port 44284c30-6edf-45a3-8b70-fc4bb36bc551 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=44284c30-6edf-45a3-8b70-fc4bb36bc551,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=44284c30-6edf-45a3-8b70-fc4bb36bc551,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=44284c30-6edf-45a3-8b70-fc4bb36bc551,segment=NetworkSegment(8f76b480-d8af-4f6a-b685-392c9daa6c91),segment_id=8f76b480-d8af-4f6a-b685-392c9daa6c91)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:08.965482 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30e369ef-1f2a-4fd6-b564-80b3bd3ef671 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (44284c30-6edf-45a3-8b70-fc4bb36bc551), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:09.542274 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:303 started Sep 27 04:22:09.544947 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=369000000,duration_sec=619,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:09.545547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:09.545969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:303 - starting polling. Elapsed:0.004 Sep 27 04:22:09.550321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:09.552175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:303 - port information retrieved. Elapsed:0.010 Sep 27 04:22:09.552501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:303 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:22:10.270345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 9d990fa5-a24c-4b14-8c63-0e0506b80887 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:10.270882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9d990fa5-a24c-4b14-8c63-0e0506b80887), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:11.543232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:304 started Sep 27 04:22:11.546293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=370000000,duration_sec=621,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:11.546874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:11.547205 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:304 - starting polling. Elapsed:0.004 Sep 27 04:22:11.549960 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:11.553684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:304 - port information retrieved. Elapsed:0.011 Sep 27 04:22:11.554282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:304 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:22:12.151775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 44284c30-6edf-45a3-8b70-fc4bb36bc551 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:12.152331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (44284c30-6edf-45a3-8b70-fc4bb36bc551), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:13.544494 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:305 started Sep 27 04:22:13.548677 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=373000000,duration_sec=623,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:13.549629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:13.550084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:305 - starting polling. Elapsed:0.005 Sep 27 04:22:13.556839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:13.560513 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:305 - port information retrieved. Elapsed:0.016 Sep 27 04:22:13.560956 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:305 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 27 04:22:14.330846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 44284c30-6edf-45a3-8b70-fc4bb36bc551 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:14.332210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (44284c30-6edf-45a3-8b70-fc4bb36bc551), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:14.456301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:14.463216 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:14.847996 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Resource SecurityGroup deleted: 31b26620-a24b-4460-9a83-4151d3e45dd4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:14.849070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (31b26620-a24b-4460-9a83-4151d3e45dd4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:14.849582 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('31b26620-a24b-4460-9a83-4151d3e45dd4',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:22:14.867168 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('31b26620-a24b-4460-9a83-4151d3e45dd4',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:22:14.867720 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Resource SecurityGroupRule deleted: 09b52cbb-75e8-41dc-88a6-edd9c2aff166 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:14.868127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (09b52cbb-75e8-41dc-88a6-edd9c2aff166), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:14.868470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Security group rule updated ['31b26620-a24b-4460-9a83-4151d3e45dd4'] Sep 27 04:22:14.868873 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Resource SecurityGroupRule deleted: 52d77ab3-a9f0-4aaa-913e-4e7e1024d20f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:14.869227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (52d77ab3-a9f0-4aaa-913e-4e7e1024d20f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:14.869569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Security group rule updated ['31b26620-a24b-4460-9a83-4151d3e45dd4'] Sep 27 04:22:14.870359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Resource SecurityGroupRule deleted: 53c5d239-10d2-4e02-b51d-c360d91abb76 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:14.870713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (53c5d239-10d2-4e02-b51d-c360d91abb76), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:14.871039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Security group rule updated ['31b26620-a24b-4460-9a83-4151d3e45dd4'] Sep 27 04:22:14.871414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Resource SecurityGroupRule deleted: b3d7badc-40af-466d-b41b-92a8ba6ad5f8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:14.871792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b3d7badc-40af-466d-b41b-92a8ba6ad5f8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:14.872116 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-883d63c4-f600-4091-b755-ffb4da0e6bda admin admin] Security group rule updated ['31b26620-a24b-4460-9a83-4151d3e45dd4'] Sep 27 04:22:15.552552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:306 started Sep 27 04:22:15.557297 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c7d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=379000000,duration_sec=625,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:15.557944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:15.558461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:306 - starting polling. Elapsed:0.006 Sep 27 04:22:15.561144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:15.565370 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:306 - port information retrieved. Elapsed:0.013 Sep 27 04:22:15.565479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:306 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 27 04:22:16.071880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:16.072629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:17.561869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:307 started Sep 27 04:22:17.565360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c7f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=389000000,duration_sec=627,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:17.566163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:17.566512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:307 - starting polling. Elapsed:0.005 Sep 27 04:22:17.569439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:17.573288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:307 - port information retrieved. Elapsed:0.011 Sep 27 04:22:17.573707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:307 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:22:19.563419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:308 started Sep 27 04:22:19.565959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c81,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=390000000,duration_sec=629,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:19.566844 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:19.567303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:308 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:21.564675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:309 started Sep 27 04:22:21.569058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c83,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=392000000,duration_sec=631,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:21.569058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:21.569058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:309 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:23.565234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:310 started Sep 27 04:22:23.568203 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c85,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=392000000,duration_sec=633,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:23.569080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:23.569436 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:310 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:25.566617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:311 started Sep 27 04:22:25.569054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c87,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=393000000,duration_sec=635,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:25.569632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:25.570028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:311 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:26.910912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-409fdd60-91d3-4bc9-8b29-da87b56f652f tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:22:26Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ceff52d4-58ff-442f-a2d2-6e7f95b91ed2,mac_address=fa:16:3e:1f:9d:93,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ceff52d4-58ff-442f-a2d2-6e7f95b91ed2),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:22:26Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:26.912897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-409fdd60-91d3-4bc9-8b29-da87b56f652f tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ceff52d4-58ff-442f-a2d2-6e7f95b91ed2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:27.568562 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:312 started Sep 27 04:22:27.571034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c89,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=395000000,duration_sec=637,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:27.571625 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:27.571961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:312 - starting polling. Elapsed:0.004 Sep 27 04:22:27.578299 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:27.590229 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:312 - port information retrieved. Elapsed:0.021 Sep 27 04:22:27.591877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:312 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.022 Sep 27 04:22:28.396925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-409fdd60-91d3-4bc9-8b29-da87b56f652f tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource Port ceff52d4-58ff-442f-a2d2-6e7f95b91ed2 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '9963a87b-03b4-4d55-83d3-de04f644946b'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:28.397575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-409fdd60-91d3-4bc9-8b29-da87b56f652f tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ceff52d4-58ff-442f-a2d2-6e7f95b91ed2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:29.316745 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30e3711b-496f-44c3-9a80-6358d00a1bdc tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:22:29Z,description='tempest-secgroup-smoke-1666472914 description',id=e17d595b-0c19-4926-adc1-40062a9006bc,is_default=False,name='tempest-secgroup-smoke-1666472914',project_id='7e7b2ff0f0104769a550d0c0692ab713',revision_number=1,rules=[SecurityGroupRule(91414bcc-442f-45de-8aa6-0b0c941557a2),SecurityGroupRule(b96e535f-2db5-4cb0-9c59-460b568fe4f7)],shared=False,stateful=True,updated_at=2022-09-27T04:22:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:29.317135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30e3711b-496f-44c3-9a80-6358d00a1bdc tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (e17d595b-0c19-4926-adc1-40062a9006bc), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:29.317809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30e3711b-496f-44c3-9a80-6358d00a1bdc tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:29Z,description=,direction='egress',ethertype='IPv6',id=91414bcc-442f-45de-8aa6-0b0c941557a2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e17d595b-0c19-4926-adc1-40062a9006bc,updated_at=2022-09-27T04:22:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:29.318244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30e3711b-496f-44c3-9a80-6358d00a1bdc tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (91414bcc-442f-45de-8aa6-0b0c941557a2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:29.318575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-30e3711b-496f-44c3-9a80-6358d00a1bdc tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:22:29.319251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30e3711b-496f-44c3-9a80-6358d00a1bdc tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:29Z,description=,direction='egress',ethertype='IPv4',id=b96e535f-2db5-4cb0-9c59-460b568fe4f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e17d595b-0c19-4926-adc1-40062a9006bc,updated_at=2022-09-27T04:22:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:29.319611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30e3711b-496f-44c3-9a80-6358d00a1bdc tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b96e535f-2db5-4cb0-9c59-460b568fe4f7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:29.320850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-30e3711b-496f-44c3-9a80-6358d00a1bdc tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:22:29.550183 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7e1e5f05-0ffd-490b-bccc-567b17525db2 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:29Z,description='',direction='ingress',ethertype='IPv4',id=f8481a1d-c125-4252-b9b1-e384051d0ab5,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e17d595b-0c19-4926-adc1-40062a9006bc,updated_at=2022-09-27T04:22:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:29.551499 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7e1e5f05-0ffd-490b-bccc-567b17525db2 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f8481a1d-c125-4252-b9b1-e384051d0ab5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:29.552114 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7e1e5f05-0ffd-490b-bccc-567b17525db2 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:22:29.571498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:313 started Sep 27 04:22:29.579391 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c8b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=401000000,duration_sec=639,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:29.594495 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:29.594879 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:313 - starting polling. Elapsed:0.024 Sep 27 04:22:29.601435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:29.609383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:313 - port information retrieved. Elapsed:0.039 Sep 27 04:22:29.615450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:313 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.039 Sep 27 04:22:29.800334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e746d21-9b35-4893-ad5d-6fc18ef5dc67 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:29Z,description='',direction='egress',ethertype='IPv4',id=3736d603-8cc8-4dbc-83a1-d217186948d4,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e17d595b-0c19-4926-adc1-40062a9006bc,updated_at=2022-09-27T04:22:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:29.801867 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e746d21-9b35-4893-ad5d-6fc18ef5dc67 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3736d603-8cc8-4dbc-83a1-d217186948d4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:29.804350 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3e746d21-9b35-4893-ad5d-6fc18ef5dc67 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:22:30.027676 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b5011920-9bf4-49ad-af2c-584132e3cfc5 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:29Z,description='',direction='ingress',ethertype='IPv4',id=8cfef89d-1afa-48eb-b3c2-53be90f45bb7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e17d595b-0c19-4926-adc1-40062a9006bc,updated_at=2022-09-27T04:22:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:30.028897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b5011920-9bf4-49ad-af2c-584132e3cfc5 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8cfef89d-1afa-48eb-b3c2-53be90f45bb7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:30.030092 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b5011920-9bf4-49ad-af2c-584132e3cfc5 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:22:30.181381 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5e989be0-2bd0-4ca6-998a-cce59e982e38 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:30Z,description='',direction='egress',ethertype='IPv4',id=26955629-8b2d-4cf0-a832-efda0b5427a3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e17d595b-0c19-4926-adc1-40062a9006bc,updated_at=2022-09-27T04:22:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:30.182252 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5e989be0-2bd0-4ca6-998a-cce59e982e38 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (26955629-8b2d-4cf0-a832-efda0b5427a3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:30.184116 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5e989be0-2bd0-4ca6-998a-cce59e982e38 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:22:30.404023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b5d7d274-3134-4d7d-bdf1-9a4e268d8b5f tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:30Z,description='',direction='ingress',ethertype='IPv6',id=6b359112-f112-4a40-9ed8-fee02c33a108,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e17d595b-0c19-4926-adc1-40062a9006bc,updated_at=2022-09-27T04:22:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:30.404739 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b5d7d274-3134-4d7d-bdf1-9a4e268d8b5f tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6b359112-f112-4a40-9ed8-fee02c33a108), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:30.405387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b5d7d274-3134-4d7d-bdf1-9a4e268d8b5f tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:22:30.551080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2b3bd4c2-1470-4173-ac28-b890a8a1c8bd tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:30Z,description='',direction='egress',ethertype='IPv6',id=142d71d5-e223-4760-8d6b-2307df8d5584,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e7b2ff0f0104769a550d0c0692ab713',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e17d595b-0c19-4926-adc1-40062a9006bc,updated_at=2022-09-27T04:22:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:30.551734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2b3bd4c2-1470-4173-ac28-b890a8a1c8bd tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (142d71d5-e223-4760-8d6b-2307df8d5584), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:30.551986 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2b3bd4c2-1470-4173-ac28-b890a8a1c8bd tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:22:31.111340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5e14e069-0eb8-4c15-adf5-7d870c20421e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource Port 9d990fa5-a24c-4b14-8c63-0e0506b80887 updated (revision_number 5->6). Old fields: {'security_group_ids': CoercedSet({'2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'})} New fields: {'security_group_ids': CoercedSet({'2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66', 'e17d595b-0c19-4926-adc1-40062a9006bc'})} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:31.111868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5e14e069-0eb8-4c15-adf5-7d870c20421e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9d990fa5-a24c-4b14-8c63-0e0506b80887), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:31.112552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5e14e069-0eb8-4c15-adf5-7d870c20421e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group member updated {'2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66', 'e17d595b-0c19-4926-adc1-40062a9006bc'} Sep 27 04:22:31.577666 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:314 started Sep 27 04:22:31.580102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c8d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=404000000,duration_sec=641,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:31.580678 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:31.581047 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:314 - starting polling. Elapsed:0.004 Sep 27 04:22:31.584431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:31.588254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:314 - port information retrieved. Elapsed:0.011 Sep 27 04:22:31.588594 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:314 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:22:33.556630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:22:33Z,description='Default security group',id=657f3b2b-911d-4bbb-b655-53dea313594b,is_default=True,name='default',project_id='a613cbeb387243ccb4d167d82c5068de',revision_number=1,rules=[SecurityGroupRule(2712c117-9d79-4212-a88a-7321336fd735),SecurityGroupRule(5570afd1-7d64-4734-bfdd-e8e865cd3bf3),SecurityGroupRule(59d9a4cc-bdca-416e-8f8d-6a07b248c88a),SecurityGroupRule(5dcd0214-60e0-4872-a0ab-bdbbd8d6625f)],shared=False,stateful=True,updated_at=2022-09-27T04:22:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:33.557225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (657f3b2b-911d-4bbb-b655-53dea313594b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:33.557735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:33Z,description=,direction='egress',ethertype='IPv4',id=2712c117-9d79-4212-a88a-7321336fd735,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a613cbeb387243ccb4d167d82c5068de',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=657f3b2b-911d-4bbb-b655-53dea313594b,updated_at=2022-09-27T04:22:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:33.558410 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2712c117-9d79-4212-a88a-7321336fd735), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:33.558818 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Security group rule updated ['657f3b2b-911d-4bbb-b655-53dea313594b'] Sep 27 04:22:33.559674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:33Z,description=,direction='ingress',ethertype='IPv4',id=5570afd1-7d64-4734-bfdd-e8e865cd3bf3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a613cbeb387243ccb4d167d82c5068de',protocol=,remote_address_group_id=,remote_group_id=657f3b2b-911d-4bbb-b655-53dea313594b,remote_ip_prefix=,revision_number=0,security_group_id=657f3b2b-911d-4bbb-b655-53dea313594b,updated_at=2022-09-27T04:22:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:33.559955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5570afd1-7d64-4734-bfdd-e8e865cd3bf3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:33.560510 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Security group rule updated ['657f3b2b-911d-4bbb-b655-53dea313594b'] Sep 27 04:22:33.561221 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:33Z,description=,direction='ingress',ethertype='IPv6',id=59d9a4cc-bdca-416e-8f8d-6a07b248c88a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a613cbeb387243ccb4d167d82c5068de',protocol=,remote_address_group_id=,remote_group_id=657f3b2b-911d-4bbb-b655-53dea313594b,remote_ip_prefix=,revision_number=0,security_group_id=657f3b2b-911d-4bbb-b655-53dea313594b,updated_at=2022-09-27T04:22:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:33.561644 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (59d9a4cc-bdca-416e-8f8d-6a07b248c88a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:33.562197 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Security group rule updated ['657f3b2b-911d-4bbb-b655-53dea313594b'] Sep 27 04:22:33.563180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:33Z,description=,direction='egress',ethertype='IPv6',id=5dcd0214-60e0-4872-a0ab-bdbbd8d6625f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a613cbeb387243ccb4d167d82c5068de',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=657f3b2b-911d-4bbb-b655-53dea313594b,updated_at=2022-09-27T04:22:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:33.563616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5dcd0214-60e0-4872-a0ab-bdbbd8d6625f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:33.564010 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-43939580-3a63-4935-a4b8-351ab017af82 admin admin] Security group rule updated ['657f3b2b-911d-4bbb-b655-53dea313594b'] Sep 27 04:22:33.578597 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:315 started Sep 27 04:22:33.581421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c8f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=406000000,duration_sec=643,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:33.582723 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:33.583247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:315 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:22:33.712430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Resource SecurityGroup deleted: 657f3b2b-911d-4bbb-b655-53dea313594b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:33.713121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (657f3b2b-911d-4bbb-b655-53dea313594b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:33.713704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('657f3b2b-911d-4bbb-b655-53dea313594b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:22:33.731765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('657f3b2b-911d-4bbb-b655-53dea313594b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:22:33.732469 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Resource SecurityGroupRule deleted: 2712c117-9d79-4212-a88a-7321336fd735 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:33.733094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2712c117-9d79-4212-a88a-7321336fd735), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:33.734364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Security group rule updated ['657f3b2b-911d-4bbb-b655-53dea313594b'] Sep 27 04:22:33.735275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Resource SecurityGroupRule deleted: 5570afd1-7d64-4734-bfdd-e8e865cd3bf3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:33.736164 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5570afd1-7d64-4734-bfdd-e8e865cd3bf3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:33.736684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Security group rule updated ['657f3b2b-911d-4bbb-b655-53dea313594b'] Sep 27 04:22:33.737361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Resource SecurityGroupRule deleted: 59d9a4cc-bdca-416e-8f8d-6a07b248c88a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:33.737885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (59d9a4cc-bdca-416e-8f8d-6a07b248c88a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:33.738374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Security group rule updated ['657f3b2b-911d-4bbb-b655-53dea313594b'] Sep 27 04:22:33.739067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Resource SecurityGroupRule deleted: 5dcd0214-60e0-4872-a0ab-bdbbd8d6625f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:33.739562 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5dcd0214-60e0-4872-a0ab-bdbbd8d6625f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:33.740038 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ba4091b6-d8bd-4661-af87-a8fcdc978ac1 admin admin] Security group rule updated ['657f3b2b-911d-4bbb-b655-53dea313594b'] Sep 27 04:22:34.144251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:22:34.144642 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:35.579458 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:316 started Sep 27 04:22:35.581688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c91,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=406000000,duration_sec=645,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:35.582326 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:35.582662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:316 - starting polling. Elapsed:0.003 Sep 27 04:22:35.585298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:35.588749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:316 - port information retrieved. Elapsed:0.010 Sep 27 04:22:35.589083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:316 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:22:37.580425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:317 started Sep 27 04:22:37.582798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c93,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=407000000,duration_sec=647,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:37.583360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:37.583703 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:317 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:22:39.580920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:318 started Sep 27 04:22:39.583302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c95,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=407000000,duration_sec=649,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:39.583869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:39.584219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:318 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:22:41.581682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:319 started Sep 27 04:22:41.585232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c97,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=409000000,duration_sec=651,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:41.585826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:41.586184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:319 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:22:43.582777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:320 started Sep 27 04:22:43.585106 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=409000000,duration_sec=653,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:43.585733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:43.586133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:320 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:45.583415 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:321 started Sep 27 04:22:45.586035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c9b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=410000000,duration_sec=655,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:45.586624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:45.586981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:321 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:47.584795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:322 started Sep 27 04:22:47.587862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c9d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=411000000,duration_sec=657,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:47.588490 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:47.588843 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:322 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:49.585557 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:323 started Sep 27 04:22:49.588024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22c9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=412000000,duration_sec=659,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:49.588685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:49.589109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:323 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:51.586882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:324 started Sep 27 04:22:51.589302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ca1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=413000000,duration_sec=661,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:51.589925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:51.590287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:324 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:22:53.587928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:325 started Sep 27 04:22:53.590265 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ca3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=414000000,duration_sec=663,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:53.590843 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:53.591192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:325 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:22:55.590564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:326 started Sep 27 04:22:55.594583 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ca5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=418000000,duration_sec=665,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:55.595425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:55.596068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:326 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 27 04:22:56.761999 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:22:56Z,description='Default security group',id=aeeab10f-ae44-44d4-8f21-eff0ee40ff8a,is_default=True,name='default',project_id='ff9b9972c6b646659b6defa8ffcde374',revision_number=1,rules=[SecurityGroupRule(15fed89c-a11f-41e9-add8-4a9afbfdb0a8),SecurityGroupRule(a438c554-d63c-4645-9b1d-e2bf0339fee2),SecurityGroupRule(c889af84-dd43-44eb-a852-dfaaba19613f),SecurityGroupRule(f6e40084-584b-4090-b336-a6bc30e40d77)],shared=False,stateful=True,updated_at=2022-09-27T04:22:56Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:56.762647 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (aeeab10f-ae44-44d4-8f21-eff0ee40ff8a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:56.763013 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:56Z,description=,direction='egress',ethertype='IPv6',id=15fed89c-a11f-41e9-add8-4a9afbfdb0a8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ff9b9972c6b646659b6defa8ffcde374',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=aeeab10f-ae44-44d4-8f21-eff0ee40ff8a,updated_at=2022-09-27T04:22:56Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:56.763381 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (15fed89c-a11f-41e9-add8-4a9afbfdb0a8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:56.763721 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Security group rule updated ['aeeab10f-ae44-44d4-8f21-eff0ee40ff8a'] Sep 27 04:22:56.764407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:56Z,description=,direction='ingress',ethertype='IPv6',id=a438c554-d63c-4645-9b1d-e2bf0339fee2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ff9b9972c6b646659b6defa8ffcde374',protocol=,remote_address_group_id=,remote_group_id=aeeab10f-ae44-44d4-8f21-eff0ee40ff8a,remote_ip_prefix=,revision_number=0,security_group_id=aeeab10f-ae44-44d4-8f21-eff0ee40ff8a,updated_at=2022-09-27T04:22:56Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:56.764767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a438c554-d63c-4645-9b1d-e2bf0339fee2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:56.765101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Security group rule updated ['aeeab10f-ae44-44d4-8f21-eff0ee40ff8a'] Sep 27 04:22:56.765779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:56Z,description=,direction='egress',ethertype='IPv4',id=c889af84-dd43-44eb-a852-dfaaba19613f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ff9b9972c6b646659b6defa8ffcde374',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=aeeab10f-ae44-44d4-8f21-eff0ee40ff8a,updated_at=2022-09-27T04:22:56Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:56.766139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c889af84-dd43-44eb-a852-dfaaba19613f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:56.766472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Security group rule updated ['aeeab10f-ae44-44d4-8f21-eff0ee40ff8a'] Sep 27 04:22:56.767695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:22:56Z,description=,direction='ingress',ethertype='IPv4',id=f6e40084-584b-4090-b336-a6bc30e40d77,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ff9b9972c6b646659b6defa8ffcde374',protocol=,remote_address_group_id=,remote_group_id=aeeab10f-ae44-44d4-8f21-eff0ee40ff8a,remote_ip_prefix=,revision_number=0,security_group_id=aeeab10f-ae44-44d4-8f21-eff0ee40ff8a,updated_at=2022-09-27T04:22:56Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:22:56.768294 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f6e40084-584b-4090-b336-a6bc30e40d77), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:56.768846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-240dc15c-3de3-4930-8745-c12bcb309e6d admin admin] Security group rule updated ['aeeab10f-ae44-44d4-8f21-eff0ee40ff8a'] Sep 27 04:22:56.904230 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Resource SecurityGroup deleted: aeeab10f-ae44-44d4-8f21-eff0ee40ff8a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:56.904619 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (aeeab10f-ae44-44d4-8f21-eff0ee40ff8a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:56.905086 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('aeeab10f-ae44-44d4-8f21-eff0ee40ff8a',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:22:56.922540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('aeeab10f-ae44-44d4-8f21-eff0ee40ff8a',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:22:56.923575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Resource SecurityGroupRule deleted: 15fed89c-a11f-41e9-add8-4a9afbfdb0a8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:56.924237 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (15fed89c-a11f-41e9-add8-4a9afbfdb0a8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:56.924749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Security group rule updated ['aeeab10f-ae44-44d4-8f21-eff0ee40ff8a'] Sep 27 04:22:56.925426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Resource SecurityGroupRule deleted: a438c554-d63c-4645-9b1d-e2bf0339fee2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:56.926248 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a438c554-d63c-4645-9b1d-e2bf0339fee2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:56.926742 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Security group rule updated ['aeeab10f-ae44-44d4-8f21-eff0ee40ff8a'] Sep 27 04:22:56.932814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Resource SecurityGroupRule deleted: c889af84-dd43-44eb-a852-dfaaba19613f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:56.933395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c889af84-dd43-44eb-a852-dfaaba19613f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:56.934042 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Security group rule updated ['aeeab10f-ae44-44d4-8f21-eff0ee40ff8a'] Sep 27 04:22:56.934783 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Resource SecurityGroupRule deleted: f6e40084-584b-4090-b336-a6bc30e40d77 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:22:56.935314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f6e40084-584b-4090-b336-a6bc30e40d77), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:22:56.935992 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4d06be4a-17db-4bb8-bbf5-4a95a319a41e admin admin] Security group rule updated ['aeeab10f-ae44-44d4-8f21-eff0ee40ff8a'] Sep 27 04:22:57.590487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:327 started Sep 27 04:22:57.592827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ca7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=417000000,duration_sec=667,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:57.593426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:57.593805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:327 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:22:59.591569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:328 started Sep 27 04:22:59.594603 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ca9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=419000000,duration_sec=669,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:22:59.595775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:22:59.596134 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:328 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:23:01.596946 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:329 started Sep 27 04:23:01.599355 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=424000000,duration_sec=671,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:01.599928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:01.600283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:329 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:23:03.548890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-da385eaa-f8f9-4de4-8d4f-4a90ee10b05a tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:23:03Z,description='tempest-description--755145170',id=8941aa61-f42a-42af-9d20-9d356758a62d,is_default=False,name='tempest-securitygroup--808183741',project_id='c25f11f92d4e4fd8965fe630ad77f3c3',revision_number=1,rules=[SecurityGroupRule(354954d4-b4a6-499a-b24b-530e8617dfba),SecurityGroupRule(7861d88a-9f15-4c71-865e-48edfb1f5b4a)],shared=False,stateful=True,updated_at=2022-09-27T04:23:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:23:03.549476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-da385eaa-f8f9-4de4-8d4f-4a90ee10b05a tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (8941aa61-f42a-42af-9d20-9d356758a62d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:03.550592 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-da385eaa-f8f9-4de4-8d4f-4a90ee10b05a tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:23:03Z,description=,direction='egress',ethertype='IPv6',id=354954d4-b4a6-499a-b24b-530e8617dfba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8941aa61-f42a-42af-9d20-9d356758a62d,updated_at=2022-09-27T04:23:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:23:03.550964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-da385eaa-f8f9-4de4-8d4f-4a90ee10b05a tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (354954d4-b4a6-499a-b24b-530e8617dfba), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:03.551311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-da385eaa-f8f9-4de4-8d4f-4a90ee10b05a tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group rule updated ['8941aa61-f42a-42af-9d20-9d356758a62d'] Sep 27 04:23:03.551996 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-da385eaa-f8f9-4de4-8d4f-4a90ee10b05a tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:23:03Z,description=,direction='egress',ethertype='IPv4',id=7861d88a-9f15-4c71-865e-48edfb1f5b4a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8941aa61-f42a-42af-9d20-9d356758a62d,updated_at=2022-09-27T04:23:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:23:03.552357 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-da385eaa-f8f9-4de4-8d4f-4a90ee10b05a tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7861d88a-9f15-4c71-865e-48edfb1f5b4a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:03.552693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-da385eaa-f8f9-4de4-8d4f-4a90ee10b05a tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group rule updated ['8941aa61-f42a-42af-9d20-9d356758a62d'] Sep 27 04:23:03.593254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:330 started Sep 27 04:23:03.595651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=420000000,duration_sec=673,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:03.596916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:03.597208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:330 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:03.657717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b71cc433-ea4e-41e4-9340-b4432103af7b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:23:03Z,description='',direction='ingress',ethertype='IPv4',id=cac2b0ac-07c2-43e4-ad95-c52d0599d12a,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8941aa61-f42a-42af-9d20-9d356758a62d,updated_at=2022-09-27T04:23:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:23:03.658145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b71cc433-ea4e-41e4-9340-b4432103af7b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cac2b0ac-07c2-43e4-ad95-c52d0599d12a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:03.658513 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b71cc433-ea4e-41e4-9340-b4432103af7b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group rule updated ['8941aa61-f42a-42af-9d20-9d356758a62d'] Sep 27 04:23:03.783547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4d60f742-d640-4334-b525-9a6199df48c0 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:23:03Z,description='',direction='ingress',ethertype='IPv4',id=ca202269-191e-43de-91df-9534bc15da3b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8941aa61-f42a-42af-9d20-9d356758a62d,updated_at=2022-09-27T04:23:03Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:23:03.784473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4d60f742-d640-4334-b525-9a6199df48c0 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ca202269-191e-43de-91df-9534bc15da3b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:03.784975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4d60f742-d640-4334-b525-9a6199df48c0 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group rule updated ['8941aa61-f42a-42af-9d20-9d356758a62d'] Sep 27 04:23:04.245013 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b695fec6-5069-4345-a95d-b5b32283639f tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:23:03Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=eb0cee21-53cc-4a6b-aa49-0a081413dc60,mac_address=fa:16:3e:20:b7:56,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(eb0cee21-53cc-4a6b-aa49-0a081413dc60),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:23:04Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:23:04.245403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b695fec6-5069-4345-a95d-b5b32283639f tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (eb0cee21-53cc-4a6b-aa49-0a081413dc60), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:04.352801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:04.353207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:04.592044 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b695fec6-5069-4345-a95d-b5b32283639f tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Resource Port eb0cee21-53cc-4a6b-aa49-0a081413dc60 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'ea6cc630-4c55-45c1-9b82-bbe10c92c8c7'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:04.592632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b695fec6-5069-4345-a95d-b5b32283639f tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (eb0cee21-53cc-4a6b-aa49-0a081413dc60), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:05.594236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:331 started Sep 27 04:23:05.598140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22caf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=421000000,duration_sec=675,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:05.598809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:05.599150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:331 - starting polling. Elapsed:0.005 Sep 27 04:23:05.601798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:05.605196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:331 - port information retrieved. Elapsed:0.011 Sep 27 04:23:05.605571 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:331 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:23:07.595740 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:332 started Sep 27 04:23:07.598810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cb1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=423000000,duration_sec=677,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:07.612688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:07.612688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:332 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:23:08.270515 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:08.270898 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:09.596907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:333 started Sep 27 04:23:09.599348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cb3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=424000000,duration_sec=679,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:09.599946 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:09.600283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:333 - starting polling. Elapsed:0.004 Sep 27 04:23:09.602953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:09.606462 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:333 - port information retrieved. Elapsed:0.010 Sep 27 04:23:09.606802 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:333 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:23:11.597592 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:334 started Sep 27 04:23:11.599986 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cb5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=424000000,duration_sec=681,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:11.600559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:11.600921 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:334 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:23:12.853129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dae668b4-86a3-4dbe-ab15-cb7ac57ff1e9 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:23:12Z,data_plane_status=None,description='',device_id='88ab8637-285a-4e7d-aac4-fe2fafab654e',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8760ae9b-e8ce-45d6-a54c-90337fdcb044,mac_address=fa:16:3e:a3:40:24,name='',network_id=3b03541e-a362-4f1f-858b-b7051275090d,numa_affinity_policy=,project_id='c25f11f92d4e4fd8965fe630ad77f3c3',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8760ae9b-e8ce-45d6-a54c-90337fdcb044),security_group_ids=set([8941aa61-f42a-42af-9d20-9d356758a62d]),status='DOWN',updated_at=2022-09-27T04:23:12Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:23:12.855044 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dae668b4-86a3-4dbe-ab15-cb7ac57ff1e9 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (8760ae9b-e8ce-45d6-a54c-90337fdcb044), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:12.855716 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-dae668b4-86a3-4dbe-ab15-cb7ac57ff1e9 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group member updated {'8941aa61-f42a-42af-9d20-9d356758a62d'} Sep 27 04:23:13.598078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:335 started Sep 27 04:23:13.600473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cb7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=425000000,duration_sec=683,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:13.601056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:13.601450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:335 - starting polling. Elapsed:0.004 Sep 27 04:23:13.604052 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:13.607528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:335 - port information retrieved. Elapsed:0.010 Sep 27 04:23:13.607862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:335 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:23:13.711777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f11c66e3-79cc-4c77-8012-1d2a25229bfb service neutron] Resource Port 8760ae9b-e8ce-45d6-a54c-90337fdcb044 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=8760ae9b-e8ce-45d6-a54c-90337fdcb044,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=8760ae9b-e8ce-45d6-a54c-90337fdcb044,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:13.712165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f11c66e3-79cc-4c77-8012-1d2a25229bfb service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (8760ae9b-e8ce-45d6-a54c-90337fdcb044), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:13.980528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f11c66e3-79cc-4c77-8012-1d2a25229bfb service neutron] Resource Port 8760ae9b-e8ce-45d6-a54c-90337fdcb044 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=8760ae9b-e8ce-45d6-a54c-90337fdcb044,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=8760ae9b-e8ce-45d6-a54c-90337fdcb044,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=8760ae9b-e8ce-45d6-a54c-90337fdcb044,segment=NetworkSegment(4790901f-5695-41bc-be7f-0e3d4d5126bd),segment_id=4790901f-5695-41bc-be7f-0e3d4d5126bd)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:13.981141 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f11c66e3-79cc-4c77-8012-1d2a25229bfb service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (8760ae9b-e8ce-45d6-a54c-90337fdcb044), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:15.598900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:336 started Sep 27 04:23:15.601413 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cb9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=425000000,duration_sec=685,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:15.602050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:15.602397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:336 - starting polling. Elapsed:0.004 Sep 27 04:23:15.604972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:15.608497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:336 - port information retrieved. Elapsed:0.010 Sep 27 04:23:15.608863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:336 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:23:17.600064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:337 started Sep 27 04:23:17.603445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cbb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=428000000,duration_sec=687,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:17.604639 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:17.605308 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:337 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:23:19.601020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:338 started Sep 27 04:23:19.603457 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cbd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=428000000,duration_sec=689,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:19.604249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:19.604682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:338 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:21.495151 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 8760ae9b-e8ce-45d6-a54c-90337fdcb044 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:21.496008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (8760ae9b-e8ce-45d6-a54c-90337fdcb044), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:21.602054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:339 started Sep 27 04:23:21.604917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cbf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=429000000,duration_sec=691,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:21.605496 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:21.605866 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:339 - starting polling. Elapsed:0.004 Sep 27 04:23:21.608412 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:21.611904 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:339 - port information retrieved. Elapsed:0.010 Sep 27 04:23:21.612234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:339 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:23:23.451680 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 8760ae9b-e8ce-45d6-a54c-90337fdcb044 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:23.452334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (8760ae9b-e8ce-45d6-a54c-90337fdcb044), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:23.602882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:340 started Sep 27 04:23:23.605568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cc1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=429000000,duration_sec=693,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:23.606204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:23.606547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:340 - starting polling. Elapsed:0.004 Sep 27 04:23:23.609097 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:23.612546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:340 - port information retrieved. Elapsed:0.010 Sep 27 04:23:23.612891 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:340 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:23:24.866218 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c9063ae4-c418-47d3-9454-a8b198f2b6a0 tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Resource Port deleted: 44284c30-6edf-45a3-8b70-fc4bb36bc551 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:23:24.866708 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c9063ae4-c418-47d3-9454-a8b198f2b6a0 tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (44284c30-6edf-45a3-8b70-fc4bb36bc551), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:24.867060 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c9063ae4-c418-47d3-9454-a8b198f2b6a0 tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Security group member updated {'b085b3fa-48ce-47db-8026-9c8743b70349'} Sep 27 04:23:25.604123 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:341 started Sep 27 04:23:25.606736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cc3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=431000000,duration_sec=695,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:25.607311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:25.607653 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:341 - starting polling. Elapsed:0.004 Sep 27 04:23:25.610200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:25.611963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 44284c30-6edf-45a3-8b70-fc4bb36bc551 not present in bridge br-int Sep 27 04:23:25.612310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:23:25.612599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['44284c30-6edf-45a3-8b70-fc4bb36bc551'] Sep 27 04:23:25.612924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 44284c30-6edf-45a3-8b70-fc4bb36bc551 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:23:25.616819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:341 - port information retrieved. Elapsed:0.013 Sep 27 04:23:25.617153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:341 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 27 04:23:27.604936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:342 started Sep 27 04:23:27.608142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cc5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=432000000,duration_sec=697,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:27.608723 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:27.609081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:342 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:29.606309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:343 started Sep 27 04:23:29.608745 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cc7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=433000000,duration_sec=699,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:29.609734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:29.610189 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:343 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:31.607380 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:344 started Sep 27 04:23:31.609769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cc9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=434000000,duration_sec=701,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:31.610342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:31.610693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:344 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:33.608101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:345 started Sep 27 04:23:33.610515 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ccb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=435000000,duration_sec=703,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:33.611086 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:33.611434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:345 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:35.609337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:346 started Sep 27 04:23:35.612022 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ccd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=436000000,duration_sec=705,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:35.612587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:35.612959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:346 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:37.610073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:347 started Sep 27 04:23:37.612500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ccf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=437000000,duration_sec=707,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:37.613121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:37.613538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:347 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:39.563394 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d6eb36aa-705d-488f-929a-c732ea0dca26 tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:23:39Z,data_plane_status=None,description='',device_id='dc919c44-b977-44e9-9c89-e92bcf1cebe6',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0fe69958-0631-4361-8934-1da42bed69db,mac_address=fa:16:3e:00:94:8f,name='',network_id=14e40f69-7e37-43ea-ba44-fd89b3b60419,numa_affinity_policy=,project_id='14d42cf78c32468cb8bf10aa847c7cc3',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0fe69958-0631-4361-8934-1da42bed69db),security_group_ids=set([b085b3fa-48ce-47db-8026-9c8743b70349]),status='DOWN',updated_at=2022-09-27T04:23:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:23:39.564074 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d6eb36aa-705d-488f-929a-c732ea0dca26 tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0fe69958-0631-4361-8934-1da42bed69db), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:39.564459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d6eb36aa-705d-488f-929a-c732ea0dca26 tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Security group member updated {'b085b3fa-48ce-47db-8026-9c8743b70349'} Sep 27 04:23:39.610672 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:348 started Sep 27 04:23:39.613038 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cd1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=437000000,duration_sec=709,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:39.613617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:39.613987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:348 - starting polling. Elapsed:0.003 Sep 27 04:23:39.616541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:39.620027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:348 - port information retrieved. Elapsed:0.009 Sep 27 04:23:39.620356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:348 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:23:40.280184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-faef891a-8fd5-4426-848d-1b6f5ff27662 service neutron] Resource Port 0fe69958-0631-4361-8934-1da42bed69db updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0fe69958-0631-4361-8934-1da42bed69db,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=0fe69958-0631-4361-8934-1da42bed69db,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:40.280569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-faef891a-8fd5-4426-848d-1b6f5ff27662 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0fe69958-0631-4361-8934-1da42bed69db), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:40.555135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-faef891a-8fd5-4426-848d-1b6f5ff27662 service neutron] Resource Port 0fe69958-0631-4361-8934-1da42bed69db updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=0fe69958-0631-4361-8934-1da42bed69db,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=0fe69958-0631-4361-8934-1da42bed69db,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=0fe69958-0631-4361-8934-1da42bed69db,segment=NetworkSegment(8f76b480-d8af-4f6a-b685-392c9daa6c91),segment_id=8f76b480-d8af-4f6a-b685-392c9daa6c91)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:40.555855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-faef891a-8fd5-4426-848d-1b6f5ff27662 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0fe69958-0631-4361-8934-1da42bed69db), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:41.611857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:349 started Sep 27 04:23:41.614326 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cd3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=438000000,duration_sec=711,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:41.614939 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:41.615281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:349 - starting polling. Elapsed:0.004 Sep 27 04:23:41.617896 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:41.621313 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:349 - port information retrieved. Elapsed:0.010 Sep 27 04:23:41.621655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:349 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:23:43.613253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:350 started Sep 27 04:23:43.616714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cd5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=441000000,duration_sec=713,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:43.617289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:43.617651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:350 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:23:43.623580 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 0fe69958-0631-4361-8934-1da42bed69db updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:43.623961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0fe69958-0631-4361-8934-1da42bed69db), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:45.613118 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 0fe69958-0631-4361-8934-1da42bed69db updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:23:45.613822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0fe69958-0631-4361-8934-1da42bed69db), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:45.614473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:351 started Sep 27 04:23:45.617993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cd7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=442000000,duration_sec=715,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:45.618642 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:45.619671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:351 - starting polling. Elapsed:0.005 Sep 27 04:23:45.621957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:23:45.626418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:351 - port information retrieved. Elapsed:0.012 Sep 27 04:23:45.626821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:351 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:23:47.615159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:352 started Sep 27 04:23:47.617961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cd9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=442000000,duration_sec=717,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:47.618540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:47.618896 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:352 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:49.616456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:353 started Sep 27 04:23:49.619041 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cdb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=443000000,duration_sec=719,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:49.619604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:49.619952 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:353 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:51.617815 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:354 started Sep 27 04:23:51.620115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cdd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=444000000,duration_sec=721,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:51.620680 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:51.621030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:354 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:53.618506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:355 started Sep 27 04:23:53.620915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cdf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=445000000,duration_sec=723,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:53.621524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:53.621886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:355 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:55.619045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:356 started Sep 27 04:23:55.622353 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ce1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=446000000,duration_sec=725,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:55.622945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:55.623299 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:356 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:23:57.620050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:357 started Sep 27 04:23:57.622435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ce3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=447000000,duration_sec=727,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:57.622993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:57.623339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:357 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:23:59.620899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:358 started Sep 27 04:23:59.623769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ce5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=448000000,duration_sec=729,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:23:59.624374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:23:59.624726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:358 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:24:01.622209 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:359 started Sep 27 04:24:01.625112 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ce7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=449000000,duration_sec=731,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:01.625681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:01.626086 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:359 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:24:03.623512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:360 started Sep 27 04:24:03.625846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ce9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=450000000,duration_sec=733,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:03.626411 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:03.626759 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:360 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:24:05.624039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:361 started Sep 27 04:24:05.626507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ceb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=451000000,duration_sec=735,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:05.627082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:05.627439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:361 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:24:07.625015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:362 started Sep 27 04:24:07.627890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ced,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=452000000,duration_sec=737,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:07.628526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:07.628963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:362 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:24:09.625618 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:363 started Sep 27 04:24:09.627905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=452000000,duration_sec=739,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:09.628468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:09.628816 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:363 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:24:11.626403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:364 started Sep 27 04:24:11.629080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cf1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=453000000,duration_sec=741,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:11.629846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:11.630798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:364 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:24:12.079671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ef239acd-901e-44e3-8cbb-71fa08828b66 tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Resource Port deleted: 0fe69958-0631-4361-8934-1da42bed69db {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:12.080072 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ef239acd-901e-44e3-8cbb-71fa08828b66 tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (0fe69958-0631-4361-8934-1da42bed69db), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:12.080486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ef239acd-901e-44e3-8cbb-71fa08828b66 tempest-VolumesSnapshotTestJSON-699738051 tempest-VolumesSnapshotTestJSON-699738051-project] Security group member updated {'b085b3fa-48ce-47db-8026-9c8743b70349'} Sep 27 04:24:13.627767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:365 started Sep 27 04:24:13.630235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cf3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=454000000,duration_sec=743,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:13.630808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:13.631145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:365 - starting polling. Elapsed:0.004 Sep 27 04:24:13.633717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:13.635481 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 0fe69958-0631-4361-8934-1da42bed69db not present in bridge br-int Sep 27 04:24:13.635809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:24:13.636088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['0fe69958-0631-4361-8934-1da42bed69db'] Sep 27 04:24:13.636402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 0fe69958-0631-4361-8934-1da42bed69db is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:24:13.639755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:365 - port information retrieved. Elapsed:0.012 Sep 27 04:24:13.640102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:365 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:24:15.629153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:366 started Sep 27 04:24:15.631960 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cf5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=456000000,duration_sec=745,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:15.632538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:15.632899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:366 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:24:17.630210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:367 started Sep 27 04:24:17.632913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cf7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=457000000,duration_sec=747,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:17.633535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:17.633981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:367 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:24:19.631308 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:368 started Sep 27 04:24:19.633693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cf9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=458000000,duration_sec=749,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:19.634284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:19.634634 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:368 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:24:21.632304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:369 started Sep 27 04:24:21.634803 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cfb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=459000000,duration_sec=751,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:21.635368 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:21.635716 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:369 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:24:21.745223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a638b1f5-2106-484e-b242-12d67aea384d tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource Port deleted: bbab3923-3dca-428e-93ca-c5dd6eb5cde9 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:21.745935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a638b1f5-2106-484e-b242-12d67aea384d tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (bbab3923-3dca-428e-93ca-c5dd6eb5cde9), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:21.746573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a638b1f5-2106-484e-b242-12d67aea384d tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group member updated {'34ffa770-a7d9-4d84-9c61-d25f5aba0345'} Sep 27 04:24:23.633082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:370 started Sep 27 04:24:23.635712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cfd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=460000000,duration_sec=753,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:23.636300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:23.636636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:370 - starting polling. Elapsed:0.004 Sep 27 04:24:23.639300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:23.641045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 not present in bridge br-int Sep 27 04:24:23.641378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:24:23.641658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['bbab3923-3dca-428e-93ca-c5dd6eb5cde9'] Sep 27 04:24:23.642019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port bbab3923-3dca-428e-93ca-c5dd6eb5cde9 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:24:23.645455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:370 - port information retrieved. Elapsed:0.013 Sep 27 04:24:23.645813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:370 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 27 04:24:25.634425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:371 started Sep 27 04:24:25.636705 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22cff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=461000000,duration_sec=755,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:25.637278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:25.637633 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:371 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:24:26.323428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource SecurityGroup deleted: 34ffa770-a7d9-4d84-9c61-d25f5aba0345 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:26.323814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (34ffa770-a7d9-4d84-9c61-d25f5aba0345), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:26.324276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('34ffa770-a7d9-4d84-9c61-d25f5aba0345',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:24:26.336822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('34ffa770-a7d9-4d84-9c61-d25f5aba0345',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:24:26.337964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource SecurityGroupRule deleted: 530d00e7-2de0-4f44-97e1-d51c65ed934c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:26.338337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (530d00e7-2de0-4f44-97e1-d51c65ed934c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:26.338676 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['34ffa770-a7d9-4d84-9c61-d25f5aba0345'] Sep 27 04:24:26.339174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource SecurityGroupRule deleted: f1f9e60f-572c-4e65-900b-9e393c72041e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:26.339575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f1f9e60f-572c-4e65-900b-9e393c72041e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:26.339901 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['34ffa770-a7d9-4d84-9c61-d25f5aba0345'] Sep 27 04:24:26.340279 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource SecurityGroupRule deleted: 6d743cc6-d9f1-440d-885c-71164e6ec477 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:26.340649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6d743cc6-d9f1-440d-885c-71164e6ec477), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:26.340972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['34ffa770-a7d9-4d84-9c61-d25f5aba0345'] Sep 27 04:24:26.341454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource SecurityGroupRule deleted: d0c58644-d510-42d0-8615-9f47df5d4142 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:26.341827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d0c58644-d510-42d0-8615-9f47df5d4142), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:26.342152 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1e45cb4d-8aae-4601-9140-f1e61c3ae74b tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['34ffa770-a7d9-4d84-9c61-d25f5aba0345'] Sep 27 04:24:26.694888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-00661a08-7510-4a1c-bce1-4d8e47d98888 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource Port deleted: f3a8b4a6-2987-4295-939e-4a2a5803075b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:26.695529 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-00661a08-7510-4a1c-bce1-4d8e47d98888 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (f3a8b4a6-2987-4295-939e-4a2a5803075b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:26.980311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-af8d625e-a19d-47bc-93e8-548195f44c3f tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:24:26Z,description='tempest-description--1766623998',id=4a036648-69d9-4a9d-b723-5993a340c9f4,is_default=False,name='tempest-securitygroup--94112026',project_id='312fa89a4d9b43c5919b7bad5411002a',revision_number=1,rules=[SecurityGroupRule(10e45c5f-f4ef-4199-a94e-98a55cda3d27),SecurityGroupRule(aa9b8704-91fe-46a7-949a-f821be281894)],shared=False,stateful=True,updated_at=2022-09-27T04:24:26Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:26.980697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-af8d625e-a19d-47bc-93e8-548195f44c3f tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (4a036648-69d9-4a9d-b723-5993a340c9f4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:26.981318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-af8d625e-a19d-47bc-93e8-548195f44c3f tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:26Z,description=,direction='egress',ethertype='IPv4',id=10e45c5f-f4ef-4199-a94e-98a55cda3d27,normalized_cidr=None,port_range_max=,port_range_min=,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a036648-69d9-4a9d-b723-5993a340c9f4,updated_at=2022-09-27T04:24:26Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:26.981683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-af8d625e-a19d-47bc-93e8-548195f44c3f tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (10e45c5f-f4ef-4199-a94e-98a55cda3d27), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:26.982056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-af8d625e-a19d-47bc-93e8-548195f44c3f tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['4a036648-69d9-4a9d-b723-5993a340c9f4'] Sep 27 04:24:26.982726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-af8d625e-a19d-47bc-93e8-548195f44c3f tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:26Z,description=,direction='egress',ethertype='IPv6',id=aa9b8704-91fe-46a7-949a-f821be281894,normalized_cidr=None,port_range_max=,port_range_min=,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a036648-69d9-4a9d-b723-5993a340c9f4,updated_at=2022-09-27T04:24:26Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:26.983088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-af8d625e-a19d-47bc-93e8-548195f44c3f tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (aa9b8704-91fe-46a7-949a-f821be281894), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:26.983418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-af8d625e-a19d-47bc-93e8-548195f44c3f tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['4a036648-69d9-4a9d-b723-5993a340c9f4'] Sep 27 04:24:27.093688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c3883214-43ff-4abc-8894-d8f2fb8e1b40 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:27Z,description='',direction='ingress',ethertype='IPv4',id=923a22a9-d84e-422c-9e7c-31115ab5f36e,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a036648-69d9-4a9d-b723-5993a340c9f4,updated_at=2022-09-27T04:24:27Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:27.094383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c3883214-43ff-4abc-8894-d8f2fb8e1b40 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (923a22a9-d84e-422c-9e7c-31115ab5f36e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:27.095373 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c3883214-43ff-4abc-8894-d8f2fb8e1b40 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['4a036648-69d9-4a9d-b723-5993a340c9f4'] Sep 27 04:24:27.221020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-71edf651-3ada-4904-aa0b-bd270358f7c1 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:27Z,description='',direction='ingress',ethertype='IPv4',id=0f99e0f7-7e02-46b2-8f8e-06db55ce2cd8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='312fa89a4d9b43c5919b7bad5411002a',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a036648-69d9-4a9d-b723-5993a340c9f4,updated_at=2022-09-27T04:24:27Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:27.221414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-71edf651-3ada-4904-aa0b-bd270358f7c1 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0f99e0f7-7e02-46b2-8f8e-06db55ce2cd8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:27.222032 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-71edf651-3ada-4904-aa0b-bd270358f7c1 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['4a036648-69d9-4a9d-b723-5993a340c9f4'] Sep 27 04:24:27.635874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:372 started Sep 27 04:24:27.640055 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3aad5c9b-b4a7-4a2f-ab5b-1f43787de1a3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:27Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=46f78686-8131-4972-b452-475e717d6edf,mac_address=fa:16:3e:93:1e:ce,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(46f78686-8131-4972-b452-475e717d6edf),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:24:27Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:27.640438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3aad5c9b-b4a7-4a2f-ab5b-1f43787de1a3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (46f78686-8131-4972-b452-475e717d6edf), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:27.643209 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d01,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=467000000,duration_sec=757,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:27.643782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:27.644117 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:372 - starting polling. Elapsed:0.008 Sep 27 04:24:27.647646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:27.649362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port f3a8b4a6-2987-4295-939e-4a2a5803075b not present in bridge br-int Sep 27 04:24:27.649695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:24:27.650013 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['f3a8b4a6-2987-4295-939e-4a2a5803075b'] Sep 27 04:24:27.650332 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port f3a8b4a6-2987-4295-939e-4a2a5803075b is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:24:27.653886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:372 - port information retrieved. Elapsed:0.018 Sep 27 04:24:27.654219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:372 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 27 04:24:28.256250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3aad5c9b-b4a7-4a2f-ab5b-1f43787de1a3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource Port 46f78686-8131-4972-b452-475e717d6edf updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '9529d0d6-86e7-4753-98e3-8eeba2af0489'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:28.256836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3aad5c9b-b4a7-4a2f-ab5b-1f43787de1a3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (46f78686-8131-4972-b452-475e717d6edf), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:29.637405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:373 started Sep 27 04:24:29.640600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d03,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=465000000,duration_sec=759,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:29.641176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:29.641543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:373 - starting polling. Elapsed:0.004 Sep 27 04:24:29.644184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:29.647744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:373 - port information retrieved. Elapsed:0.011 Sep 27 04:24:29.648078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:373 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:24:30.875300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-92e346c7-f2cb-41bd-86c1-017e4e800eb9 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:30Z,data_plane_status=None,description='',device_id='5c6879a2-4ef5-4e16-8066-a2f05eca633c',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b5c073b9-7000-4407-b92c-8e4279bf0f72,mac_address=fa:16:3e:17:90:a7,name='',network_id=50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6,numa_affinity_policy=,project_id='312fa89a4d9b43c5919b7bad5411002a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b5c073b9-7000-4407-b92c-8e4279bf0f72),security_group_ids=set([4a036648-69d9-4a9d-b723-5993a340c9f4]),status='DOWN',updated_at=2022-09-27T04:24:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:30.875973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-92e346c7-f2cb-41bd-86c1-017e4e800eb9 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:30.876491 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-92e346c7-f2cb-41bd-86c1-017e4e800eb9 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group member updated {'4a036648-69d9-4a9d-b723-5993a340c9f4'} Sep 27 04:24:31.451736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-02c7e390-8b01-4555-b5a4-b1be72f71aa6 service neutron] Resource Port b5c073b9-7000-4407-b92c-8e4279bf0f72 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=b5c073b9-7000-4407-b92c-8e4279bf0f72,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=b5c073b9-7000-4407-b92c-8e4279bf0f72,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:31.452335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-02c7e390-8b01-4555-b5a4-b1be72f71aa6 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:31.638065 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:374 started Sep 27 04:24:31.641276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d05,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=465000000,duration_sec=761,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:31.642162 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:31.642669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:374 - starting polling. Elapsed:0.005 Sep 27 04:24:31.646586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:31.650432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:374 - port information retrieved. Elapsed:0.013 Sep 27 04:24:31.651035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:374 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 27 04:24:31.758857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-02c7e390-8b01-4555-b5a4-b1be72f71aa6 service neutron] Resource Port b5c073b9-7000-4407-b92c-8e4279bf0f72 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=b5c073b9-7000-4407-b92c-8e4279bf0f72,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=b5c073b9-7000-4407-b92c-8e4279bf0f72,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=b5c073b9-7000-4407-b92c-8e4279bf0f72,segment=NetworkSegment(188f0649-0d82-4591-a8be-8000cf940ed2),segment_id=188f0649-0d82-4591-a8be-8000cf940ed2)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:31.759254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-02c7e390-8b01-4555-b5a4-b1be72f71aa6 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:33.639309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:375 started Sep 27 04:24:33.642579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d07,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=466000000,duration_sec=763,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:33.643270 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:33.643788 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:375 - starting polling. Elapsed:0.005 Sep 27 04:24:33.646790 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:33.650363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:375 - port information retrieved. Elapsed:0.011 Sep 27 04:24:33.650795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:375 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:24:34.964141 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b5c073b9-7000-4407-b92c-8e4279bf0f72 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:34.964755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:35.409110 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f9d5fc07-97b8-4dbc-be8b-f1f3ec6b3d6b admin admin] Resource Subnet deleted: 5be11e2d-b115-4126-97e6-2a19ea72362d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:35.410161 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f9d5fc07-97b8-4dbc-be8b-f1f3ec6b3d6b admin admin] Publish callbacks [] for Subnet (5be11e2d-b115-4126-97e6-2a19ea72362d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:35.640432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:376 started Sep 27 04:24:35.643323 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d09,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=467000000,duration_sec=765,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:35.644146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:35.645361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:376 - starting polling. Elapsed:0.004 Sep 27 04:24:35.648683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:35.652210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:376 - port information retrieved. Elapsed:0.012 Sep 27 04:24:35.652614 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:376 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:24:35.707682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3188a487-be79-4c63-9f7a-ad56ab945eba admin admin] Resource Network deleted: 14e40f69-7e37-43ea-ba44-fd89b3b60419 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:35.708071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3188a487-be79-4c63-9f7a-ad56ab945eba admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (14e40f69-7e37-43ea-ba44-fd89b3b60419), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:36.047631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Resource SecurityGroup deleted: b085b3fa-48ce-47db-8026-9c8743b70349 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:36.048926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (b085b3fa-48ce-47db-8026-9c8743b70349), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:36.049682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b085b3fa-48ce-47db-8026-9c8743b70349',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:24:36.075253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b085b3fa-48ce-47db-8026-9c8743b70349',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:24:36.076375 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Resource SecurityGroupRule deleted: 4ab72a21-2183-4d78-9718-39bad9259732 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:36.077477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4ab72a21-2183-4d78-9718-39bad9259732), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:36.078634 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Security group rule updated ['b085b3fa-48ce-47db-8026-9c8743b70349'] Sep 27 04:24:36.079470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Resource SecurityGroupRule deleted: 88bd9f2e-1a21-4715-96bd-e41f04c85614 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:36.079862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (88bd9f2e-1a21-4715-96bd-e41f04c85614), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:36.080179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Security group rule updated ['b085b3fa-48ce-47db-8026-9c8743b70349'] Sep 27 04:24:36.080723 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Resource SecurityGroupRule deleted: 89c8a702-a868-461c-8e65-6f1afd7aae16 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:36.081673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (89c8a702-a868-461c-8e65-6f1afd7aae16), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:36.082188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Security group rule updated ['b085b3fa-48ce-47db-8026-9c8743b70349'] Sep 27 04:24:36.083465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Resource SecurityGroupRule deleted: e047f784-5ea2-4930-83d8-72cb31db9063 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:36.084015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e047f784-5ea2-4930-83d8-72cb31db9063), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:36.084501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-15e6a213-9aac-4d37-86c2-1c355c765a8b admin admin] Security group rule updated ['b085b3fa-48ce-47db-8026-9c8743b70349'] Sep 27 04:24:36.654831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a752cf1b-8d1f-4549-be29-dc3624dea31f tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource Port 9d990fa5-a24c-4b14-8c63-0e0506b80887 updated (revision_number 6->7). Old fields: {'security_group_ids': CoercedSet({'2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66', 'e17d595b-0c19-4926-adc1-40062a9006bc'})} New fields: {'security_group_ids': CoercedSet({'2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'})} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:36.655363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a752cf1b-8d1f-4549-be29-dc3624dea31f tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9d990fa5-a24c-4b14-8c63-0e0506b80887), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:36.655978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a752cf1b-8d1f-4549-be29-dc3624dea31f tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group member updated {'2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66', 'e17d595b-0c19-4926-adc1-40062a9006bc'} Sep 27 04:24:36.971500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource SecurityGroup deleted: e17d595b-0c19-4926-adc1-40062a9006bc {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:36.972223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (e17d595b-0c19-4926-adc1-40062a9006bc), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:36.973205 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e17d595b-0c19-4926-adc1-40062a9006bc',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:24:37.005327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e17d595b-0c19-4926-adc1-40062a9006bc',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:24:37.007143 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource SecurityGroupRule deleted: 91414bcc-442f-45de-8aa6-0b0c941557a2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:37.007737 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (91414bcc-442f-45de-8aa6-0b0c941557a2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.008280 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:24:37.009876 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource SecurityGroupRule deleted: b96e535f-2db5-4cb0-9c59-460b568fe4f7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:37.010519 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b96e535f-2db5-4cb0-9c59-460b568fe4f7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.011064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:24:37.011604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource SecurityGroupRule deleted: f8481a1d-c125-4252-b9b1-e384051d0ab5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:37.012126 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f8481a1d-c125-4252-b9b1-e384051d0ab5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.012631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:24:37.013163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource SecurityGroupRule deleted: 3736d603-8cc8-4dbc-83a1-d217186948d4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:37.014530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3736d603-8cc8-4dbc-83a1-d217186948d4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.015034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:24:37.015589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource SecurityGroupRule deleted: 8cfef89d-1afa-48eb-b3c2-53be90f45bb7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:37.016524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (8cfef89d-1afa-48eb-b3c2-53be90f45bb7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.017562 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:24:37.018138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource SecurityGroupRule deleted: 26955629-8b2d-4cf0-a832-efda0b5427a3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:37.018645 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (26955629-8b2d-4cf0-a832-efda0b5427a3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.019342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:24:37.020352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource SecurityGroupRule deleted: 6b359112-f112-4a40-9ed8-fee02c33a108 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:37.021088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6b359112-f112-4a40-9ed8-fee02c33a108), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.021808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:24:37.022701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource SecurityGroupRule deleted: 142d71d5-e223-4760-8d6b-2307df8d5584 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:37.023325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (142d71d5-e223-4760-8d6b-2307df8d5584), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.023820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78e34218-2ea8-48ee-af78-aed7d7fd8b8e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group rule updated ['e17d595b-0c19-4926-adc1-40062a9006bc'] Sep 27 04:24:37.030539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b5c073b9-7000-4407-b92c-8e4279bf0f72 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:37.031269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.597961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:24:37Z,description='Default security group',id=845607bb-5721-41b8-b96a-c86c4440186e,is_default=True,name='default',project_id='1e595829629a4dd4a7fccbdabc896cb0',revision_number=1,rules=[SecurityGroupRule(01aaf3b8-c568-4b45-8755-1d6e65197b23),SecurityGroupRule(30e7d628-7157-4275-8550-9477f50caa60),SecurityGroupRule(7776ca34-b59b-464e-a5b6-5e3ab76f6f8e),SecurityGroupRule(d2940b0a-e64c-411b-a73e-ad4c64bf10f7)],shared=False,stateful=True,updated_at=2022-09-27T04:24:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:37.597961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (845607bb-5721-41b8-b96a-c86c4440186e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.597961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:37Z,description=,direction='egress',ethertype='IPv6',id=01aaf3b8-c568-4b45-8755-1d6e65197b23,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=845607bb-5721-41b8-b96a-c86c4440186e,updated_at=2022-09-27T04:24:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:37.598697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (01aaf3b8-c568-4b45-8755-1d6e65197b23), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.598697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Security group rule updated ['845607bb-5721-41b8-b96a-c86c4440186e'] Sep 27 04:24:37.598697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:37Z,description=,direction='egress',ethertype='IPv4',id=30e7d628-7157-4275-8550-9477f50caa60,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=845607bb-5721-41b8-b96a-c86c4440186e,updated_at=2022-09-27T04:24:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:37.598697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (30e7d628-7157-4275-8550-9477f50caa60), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.599233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Security group rule updated ['845607bb-5721-41b8-b96a-c86c4440186e'] Sep 27 04:24:37.599233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:37Z,description=,direction='ingress',ethertype='IPv4',id=7776ca34-b59b-464e-a5b6-5e3ab76f6f8e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol=,remote_address_group_id=,remote_group_id=845607bb-5721-41b8-b96a-c86c4440186e,remote_ip_prefix=,revision_number=0,security_group_id=845607bb-5721-41b8-b96a-c86c4440186e,updated_at=2022-09-27T04:24:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:37.599233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7776ca34-b59b-464e-a5b6-5e3ab76f6f8e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.599233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Security group rule updated ['845607bb-5721-41b8-b96a-c86c4440186e'] Sep 27 04:24:37.599559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:37Z,description=,direction='ingress',ethertype='IPv6',id=d2940b0a-e64c-411b-a73e-ad4c64bf10f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol=,remote_address_group_id=,remote_group_id=845607bb-5721-41b8-b96a-c86c4440186e,remote_ip_prefix=,revision_number=0,security_group_id=845607bb-5721-41b8-b96a-c86c4440186e,updated_at=2022-09-27T04:24:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:37.599559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d2940b0a-e64c-411b-a73e-ad4c64bf10f7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.599559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Security group rule updated ['845607bb-5721-41b8-b96a-c86c4440186e'] Sep 27 04:24:37.641306 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:377 started Sep 27 04:24:37.643638 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d0b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=468000000,duration_sec=767,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:37.644249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:37.644577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:377 - starting polling. Elapsed:0.003 Sep 27 04:24:37.647763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.651453 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:377 - port information retrieved. Elapsed:0.010 Sep 27 04:24:37.651809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:377 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:24:37.826292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:24:37Z,description='',dns_domain=None,id=41cd98f9-b206-4445-9870-d24633bca602,mtu=1500,name='tempest-TestShelveInstance-1866947943-network',project_id='1e595829629a4dd4a7fccbdabc896cb0',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(41cd98f9-b206-4445-9870-d24633bca602),segments=[NetworkSegment(26969db0-2998-4ace-a23e-359a5b524a75)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:24:37Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:37.826887 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (41cd98f9-b206-4445-9870-d24633bca602), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.875547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5d4194e5-7c55-46fc-9d37-bdd51359b94e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource Port deleted: ceff52d4-58ff-442f-a2d2-6e7f95b91ed2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:37.876259 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5d4194e5-7c55-46fc-9d37-bdd51359b94e tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (ceff52d4-58ff-442f-a2d2-6e7f95b91ed2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-2535c2c9-3cf6-4f90-bd95-11278ca25ea4 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 41cd98f9-b206-4445-9870-d24633bca602 with segmentation id not found. Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:24:37.907091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:24:37.908268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:24:37.908268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:24:37.908268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:24:37.908268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 41cd98f9-b206-4445-9870-d24633bca602 with segmentation id not found. Sep 27 04:24:37.908268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:24:38.068212 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-38a1227c-c086-48a6-95de-248e63860471 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(6f92fc79-7d82-4961-8b3e-06c7cc4cfca1)],cidr=172.20.0.0/28,created_at=2022-09-27T04:24:37Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=c8446e81-8757-4a92-bbb2-c6d0f12abe74,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-1866947943-subnet',network_id=41cd98f9-b206-4445-9870-d24633bca602,project_id='1e595829629a4dd4a7fccbdabc896cb0',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:24:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:38.069674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-38a1227c-c086-48a6-95de-248e63860471 admin admin] Publish callbacks [] for Subnet (c8446e81-8757-4a92-bbb2-c6d0f12abe74), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:38.900075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30106a76-f514-49f6-8751-198651ea87cb None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:38Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-41cd98f9-b206-4445-9870-d24633bca602',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7297f2f3-0ebd-4cf2-93a1-8e981779a0f0,mac_address=fa:16:3e:f6:50:51,name='',network_id=41cd98f9-b206-4445-9870-d24633bca602,numa_affinity_policy=,project_id='1e595829629a4dd4a7fccbdabc896cb0',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7297f2f3-0ebd-4cf2-93a1-8e981779a0f0),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:24:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:38.901301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30106a76-f514-49f6-8751-198651ea87cb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (7297f2f3-0ebd-4cf2-93a1-8e981779a0f0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:39.059078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-49d2d560-67ef-4141-9148-03d90480191e admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:38Z,data_plane_status=None,description='',device_id='46ce92bd-e4b4-4da1-be51-d7a27f535bec',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=53a249dc-eefb-49ff-a291-f2eda1664fe8,mac_address=fa:16:3e:ff:61:24,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(53a249dc-eefb-49ff-a291-f2eda1664fe8),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:24:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:39.059579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-49d2d560-67ef-4141-9148-03d90480191e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (53a249dc-eefb-49ff-a291-f2eda1664fe8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:39.546428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30106a76-f514-49f6-8751-198651ea87cb None None] Resource Port 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=7297f2f3-0ebd-4cf2-93a1-8e981779a0f0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=7297f2f3-0ebd-4cf2-93a1-8e981779a0f0,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=7297f2f3-0ebd-4cf2-93a1-8e981779a0f0,segment=NetworkSegment(26969db0-2998-4ace-a23e-359a5b524a75),segment_id=26969db0-2998-4ace-a23e-359a5b524a75)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:39.546810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30106a76-f514-49f6-8751-198651ea87cb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (7297f2f3-0ebd-4cf2-93a1-8e981779a0f0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:39.645273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:378 started Sep 27 04:24:39.654730 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8ab30ab0-cef6-4bc0-9553-70419bda8eca","insert","tap7297f2f3-0e",["set",[]],["map",[["attached-mac","fa:16:3e:f6:50:51"],["iface-id","7297f2f3-0ebd-4cf2-93a1-8e981779a0f0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:39.703669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8ab30ab0-cef6-4bc0-9553-70419bda8eca","old",null,["set",[]],null],["","new","tap7297f2f3-0e",24,["map",[["attached-mac","fa:16:3e:f6:50:51"],["iface-id","7297f2f3-0ebd-4cf2-93a1-8e981779a0f0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:39.738795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d0d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=491000000,duration_sec=769,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:39.744938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:39.746880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:378 - starting polling. Elapsed:0.102 Sep 27 04:24:39.755215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:39.760973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ceff52d4-58ff-442f-a2d2-6e7f95b91ed2 not present in bridge br-int Sep 27 04:24:39.761634 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:24:39.762137 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['ceff52d4-58ff-442f-a2d2-6e7f95b91ed2'] Sep 27 04:24:39.762658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ceff52d4-58ff-442f-a2d2-6e7f95b91ed2 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:24:39.787267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:378 - port information retrieved. Elapsed:0.142 Sep 27 04:24:39.788258 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'afdb5bd9-6267-4259-a055-9a22757a36e0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': {'7297f2f3-0ebd-4cf2-93a1-8e981779a0f0'}, 'removed': set(), 'updated': {'7297f2f3-0ebd-4cf2-93a1-8e981779a0f0'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:24:39.788853 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-41cd98f9-b206-4445-9870-d24633bca602', 'network_id': '41cd98f9-b206-4445-9870-d24633bca602', 'port_id': '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'mac_address': 'fa:16:3e:f6:50:51', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c8446e81-8757-4a92-bbb2-c6d0f12abe74', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:39.803082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:39.803479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 updated. Details: {'device': '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-41cd98f9-b206-4445-9870-d24633bca602', 'network_id': '41cd98f9-b206-4445-9870-d24633bca602', 'port_id': '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'mac_address': 'fa:16:3e:f6:50:51', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c8446e81-8757-4a92-bbb2-c6d0f12abe74', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:24:39.803830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 10 as local vlan for net-id=41cd98f9-b206-4445-9870-d24633bca602, seg-id=144 Sep 27 04:24:39.814688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32eaf,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4240), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:39.820623 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22d0f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4106)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4240}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:39.821651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap7297f2f3-0e, col_values=(('tag', 10),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:39.822117 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap7297f2f3-0e, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:39.822561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap7297f2f3-0e, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:39.845959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap7297f2f3-0e, col_values=(('other_config', {'net_uuid': '41cd98f9-b206-4445-9870-d24633bca602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '144'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:39.865105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d11,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:39.865577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:378 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.077 Sep 27 04:24:39.866031 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:24:39.866344 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'7297f2f3-0ebd-4cf2-93a1-8e981779a0f0'} Sep 27 04:24:39.867516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:24:39.867804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:24:39.872678 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:39.934643 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9761caf7-7286-4787-88ce-ef29283ce59b]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:39.935969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:378 - agent port security group processed in 0.147 Sep 27 04:24:39.936821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:40.222021 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['7297f2f3-0ebd-4cf2-93a1-8e981779a0f0'] and devices down [] completed. Sep 27 04:24:40.222021 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:378 - ports processed. Elapsed:0.574 Sep 27 04:24:40.222021 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:378 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.574 Sep 27 04:24:40.291873 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:40.292412 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (7297f2f3-0ebd-4cf2-93a1-8e981779a0f0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:41.403712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a895f6de-b356-41fd-b18f-c4a544c576d3 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:40Z,data_plane_status=None,description='',device_id='46ce92bd-e4b4-4da1-be51-d7a27f535bec',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e4db657b-a959-4e62-b211-2cb063d743eb,mac_address=fa:16:3e:06:b0:80,name='',network_id=41cd98f9-b206-4445-9870-d24633bca602,numa_affinity_policy=,project_id='1e595829629a4dd4a7fccbdabc896cb0',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e4db657b-a959-4e62-b211-2cb063d743eb),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:24:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:41.404351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a895f6de-b356-41fd-b18f-c4a544c576d3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (e4db657b-a959-4e62-b211-2cb063d743eb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:41.527061 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-89636aba-26b6-42c6-afa8-19f02ed39cd6 None None] Resource Port 53a249dc-eefb-49ff-a291-f2eda1664fe8 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=53a249dc-eefb-49ff-a291-f2eda1664fe8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=53a249dc-eefb-49ff-a291-f2eda1664fe8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:41.527814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-89636aba-26b6-42c6-afa8-19f02ed39cd6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (53a249dc-eefb-49ff-a291-f2eda1664fe8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:41.646328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:379 started Sep 27 04:24:41.652026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d13,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=474000000,duration_sec=771,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:41.652889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:41.653395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:379 - starting polling. Elapsed:0.007 Sep 27 04:24:41.657440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:41.663917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:379 - port information retrieved. Elapsed:0.018 Sep 27 04:24:41.664304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'afdb5bd9-6267-4259-a055-9a22757a36e0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': set(), 'updated': {'7297f2f3-0ebd-4cf2-93a1-8e981779a0f0'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:24:41.665325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-41cd98f9-b206-4445-9870-d24633bca602', 'network_id': '41cd98f9-b206-4445-9870-d24633bca602', 'port_id': '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'mac_address': 'fa:16:3e:f6:50:51', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c8446e81-8757-4a92-bbb2-c6d0f12abe74', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:41.670399 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:41.671270 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 updated. Details: {'device': '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-41cd98f9-b206-4445-9870-d24633bca602', 'network_id': '41cd98f9-b206-4445-9870-d24633bca602', 'port_id': '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'mac_address': 'fa:16:3e:f6:50:51', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c8446e81-8757-4a92-bbb2-c6d0f12abe74', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 27 04:24:41.672734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap7297f2f3-0e, col_values=(('tag', 10),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:41.673410 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap7297f2f3-0e, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:41.674005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap7297f2f3-0e, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:41.674660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:24:41.676282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap7297f2f3-0e, col_values=(('other_config', {'net_uuid': '41cd98f9-b206-4445-9870-d24633bca602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '144', 'tag': '10'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:41.677220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:24:41.682206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d15,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:41.682785 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:379 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.018 Sep 27 04:24:41.683380 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:24:41.683841 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:24:41.685173 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:24:41.685624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:24:41.691388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:41.764401 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e104d267-6f10-43b2-b3bc-8d9897e6c8f3]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:41.765026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:379 - agent port security group processed in 0.100 Sep 27 04:24:41.765905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:41.840918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-89636aba-26b6-42c6-afa8-19f02ed39cd6 None None] Resource Port 53a249dc-eefb-49ff-a291-f2eda1664fe8 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=53a249dc-eefb-49ff-a291-f2eda1664fe8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=53a249dc-eefb-49ff-a291-f2eda1664fe8,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=53a249dc-eefb-49ff-a291-f2eda1664fe8,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:41.844188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-89636aba-26b6-42c6-afa8-19f02ed39cd6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (53a249dc-eefb-49ff-a291-f2eda1664fe8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:41.982527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a895f6de-b356-41fd-b18f-c4a544c576d3 admin admin] Received resource Port update without any changes: e4db657b-a959-4e62-b211-2cb063d743eb {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:24:42.387372 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['7297f2f3-0ebd-4cf2-93a1-8e981779a0f0'] and devices down [] completed. Sep 27 04:24:42.387896 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:379 - ports processed. Elapsed:0.742 Sep 27 04:24:42.388244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:379 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.742 Sep 27 04:24:42.855493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0d88cba3-046c-4222-9085-c50136737ca7","insert","qr-e4db657b-a9",["set",[]],["map",[["attached-mac","fa:16:3e:06:b0:80"],["iface-id","e4db657b-a959-4e62-b211-2cb063d743eb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:42.869673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0d88cba3-046c-4222-9085-c50136737ca7","old",null,["set",[]],null],["","new","qr-e4db657b-a9",25,["map",[["attached-mac","fa:16:3e:06:b0:80"],["iface-id","e4db657b-a959-4e62-b211-2cb063d743eb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:43.333307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:24:43Z,description='Default security group',id=896ea457-a0ac-4630-8bb9-fe121ebeac4d,is_default=True,name='default',project_id='4af948c97bfd43789719fb833d38e164',revision_number=1,rules=[SecurityGroupRule(59c66021-677b-4850-9c8a-7f0774ccb077),SecurityGroupRule(b58bffdd-ca37-4987-a0da-8ad79d609fb2),SecurityGroupRule(e5564a17-879e-44c1-bebe-8126c3e555ed),SecurityGroupRule(fa0ace9c-0c7f-4ab9-b4f2-a4e4097fa4b2)],shared=False,stateful=True,updated_at=2022-09-27T04:24:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:43.335075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (896ea457-a0ac-4630-8bb9-fe121ebeac4d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:43.335899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:43Z,description=,direction='ingress',ethertype='IPv4',id=59c66021-677b-4850-9c8a-7f0774ccb077,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4af948c97bfd43789719fb833d38e164',protocol=,remote_address_group_id=,remote_group_id=896ea457-a0ac-4630-8bb9-fe121ebeac4d,remote_ip_prefix=,revision_number=0,security_group_id=896ea457-a0ac-4630-8bb9-fe121ebeac4d,updated_at=2022-09-27T04:24:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:43.336743 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (59c66021-677b-4850-9c8a-7f0774ccb077), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:43.337257 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Security group rule updated ['896ea457-a0ac-4630-8bb9-fe121ebeac4d'] Sep 27 04:24:43.338164 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:43Z,description=,direction='ingress',ethertype='IPv6',id=b58bffdd-ca37-4987-a0da-8ad79d609fb2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4af948c97bfd43789719fb833d38e164',protocol=,remote_address_group_id=,remote_group_id=896ea457-a0ac-4630-8bb9-fe121ebeac4d,remote_ip_prefix=,revision_number=0,security_group_id=896ea457-a0ac-4630-8bb9-fe121ebeac4d,updated_at=2022-09-27T04:24:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:43.338674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b58bffdd-ca37-4987-a0da-8ad79d609fb2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:43.339182 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Security group rule updated ['896ea457-a0ac-4630-8bb9-fe121ebeac4d'] Sep 27 04:24:43.340093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:43Z,description=,direction='egress',ethertype='IPv6',id=e5564a17-879e-44c1-bebe-8126c3e555ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4af948c97bfd43789719fb833d38e164',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=896ea457-a0ac-4630-8bb9-fe121ebeac4d,updated_at=2022-09-27T04:24:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:43.341946 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e5564a17-879e-44c1-bebe-8126c3e555ed), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:43.342600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Security group rule updated ['896ea457-a0ac-4630-8bb9-fe121ebeac4d'] Sep 27 04:24:43.343957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:43Z,description=,direction='egress',ethertype='IPv4',id=fa0ace9c-0c7f-4ab9-b4f2-a4e4097fa4b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4af948c97bfd43789719fb833d38e164',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=896ea457-a0ac-4630-8bb9-fe121ebeac4d,updated_at=2022-09-27T04:24:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:43.344786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (fa0ace9c-0c7f-4ab9-b4f2-a4e4097fa4b2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:43.346677 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Security group rule updated ['896ea457-a0ac-4630-8bb9-fe121ebeac4d'] Sep 27 04:24:43.393512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7b44b2b1-6b3a-4963-a1a8-b36027018057","insert","qg-53a249dc-ee",["set",[]],["map",[["attached-mac","fa:16:3e:ff:61:24"],["iface-id","53a249dc-eefb-49ff-a291-f2eda1664fe8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:43.426488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7b44b2b1-6b3a-4963-a1a8-b36027018057","old",null,["set",[]],null],["","new","qg-53a249dc-ee",26,["map",[["attached-mac","fa:16:3e:ff:61:24"],["iface-id","53a249dc-eefb-49ff-a291-f2eda1664fe8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:43.513800 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:24:43Z,description='',dns_domain=None,id=5a310953-8b80-4c4f-86d4-ab083fbc1003,mtu=1500,name='tempest-TestShelveInstance-1208588778-network',project_id='4af948c97bfd43789719fb833d38e164',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(5a310953-8b80-4c4f-86d4-ab083fbc1003),segments=[NetworkSegment(f504d49b-f85a-4d4e-8352-634bdc19d78f)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:24:43Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:43.514535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (5a310953-8b80-4c4f-86d4-ab083fbc1003), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-1809cd0d-0b59-423d-94b4-39e64e549884 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5a310953-8b80-4c4f-86d4-ab083fbc1003 with segmentation id not found. Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:24:43.593127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:24:43.594227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:24:43.594227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:24:43.594227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:24:43.594227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5a310953-8b80-4c4f-86d4-ab083fbc1003 with segmentation id not found. Sep 27 04:24:43.594227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:24:43.648023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:380 started Sep 27 04:24:43.651335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d17,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=475000000,duration_sec=773,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:43.651933 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:43.652488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:380 - starting polling. Elapsed:0.005 Sep 27 04:24:43.655593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:43.659563 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:380 - port information retrieved. Elapsed:0.012 Sep 27 04:24:43.659911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', '133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'afdb5bd9-6267-4259-a055-9a22757a36e0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': {'e4db657b-a959-4e62-b211-2cb063d743eb', '53a249dc-eefb-49ff-a291-f2eda1664fe8'}, 'removed': set(), 'updated': {'53a249dc-eefb-49ff-a291-f2eda1664fe8'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:24:43.660855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:40Z,data_plane_status=None,description='',device_id='46ce92bd-e4b4-4da1-be51-d7a27f535bec',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e4db657b-a959-4e62-b211-2cb063d743eb,mac_address=fa:16:3e:06:b0:80,name='',network_id=41cd98f9-b206-4445-9870-d24633bca602,numa_affinity_policy=,project_id='1e595829629a4dd4a7fccbdabc896cb0',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(e4db657b-a959-4e62-b211-2cb063d743eb),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:24:41Z) is not bound. Sep 27 04:24:43.661673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '53a249dc-eefb-49ff-a291-f2eda1664fe8', 'device_id': '46ce92bd-e4b4-4da1-be51-d7a27f535bec', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '53a249dc-eefb-49ff-a291-f2eda1664fe8', 'mac_address': 'fa:16:3e:ff:61:24', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.15'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:43.665976 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: e4db657b-a959-4e62-b211-2cb063d743eb {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:43.666272 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device e4db657b-a959-4e62-b211-2cb063d743eb not defined on plugin or binding failed Sep 27 04:24:43.666826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 53a249dc-eefb-49ff-a291-f2eda1664fe8 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:43.667161 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 53a249dc-eefb-49ff-a291-f2eda1664fe8 updated. Details: {'device': '53a249dc-eefb-49ff-a291-f2eda1664fe8', 'device_id': '46ce92bd-e4b4-4da1-be51-d7a27f535bec', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '53a249dc-eefb-49ff-a291-f2eda1664fe8', 'mac_address': 'fa:16:3e:ff:61:24', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.15'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:24:43.668128 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-53a249dc-ee, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:43.668553 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-53a249dc-ee, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:43.668985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-53a249dc-ee, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:43.676795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-53a249dc-ee, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:43.689303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d19,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:43.690298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:380 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.030 Sep 27 04:24:43.690888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 2 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:24:43.691265 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'e4db657b-a959-4e62-b211-2cb063d743eb', '53a249dc-eefb-49ff-a291-f2eda1664fe8'} Sep 27 04:24:43.693709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:24:43.694154 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:24:43.699414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:43.743267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[256f83ea-3b0d-4115-8457-c58500eabc35]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:43.744178 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:380 - agent port security group processed in 0.084 Sep 27 04:24:43.745708 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 53a249dc-eefb-49ff-a291-f2eda1664fe8 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:43.809422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-eff0fcf1-afe4-4300-a16b-67226715eb49 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(2ebba512-d28d-41f7-b6c1-b45ccffa67da)],cidr=172.20.0.0/28,created_at=2022-09-27T04:24:43Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=ace747cf-2ef4-4c62-b777-44656539b2e3,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-1208588778-subnet',network_id=5a310953-8b80-4c4f-86d4-ab083fbc1003,project_id='4af948c97bfd43789719fb833d38e164',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:24:43Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:43.810279 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-eff0fcf1-afe4-4300-a16b-67226715eb49 admin admin] Publish callbacks [] for Subnet (ace747cf-2ef4-4c62-b777-44656539b2e3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:44.035681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['53a249dc-eefb-49ff-a291-f2eda1664fe8'] and devices down [] completed. Sep 27 04:24:44.036358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:380 - ports processed. Elapsed:0.389 Sep 27 04:24:44.036445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:380 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 1, 'removed': 0}}. Elapsed:0.389 Sep 27 04:24:44.143631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port 53a249dc-eefb-49ff-a291-f2eda1664fe8 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=53a249dc-eefb-49ff-a291-f2eda1664fe8,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=53a249dc-eefb-49ff-a291-f2eda1664fe8,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:44.145478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (53a249dc-eefb-49ff-a291-f2eda1664fe8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:44.570142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c4fe8122-957e-4a6e-a78e-348131327f9b None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:44Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-5a310953-8b80-4c4f-86d4-ab083fbc1003',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c74bfff2-6b41-4e9a-bba6-dfaded2b10c0,mac_address=fa:16:3e:ae:1d:61,name='',network_id=5a310953-8b80-4c4f-86d4-ab083fbc1003,numa_affinity_policy=,project_id='4af948c97bfd43789719fb833d38e164',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c74bfff2-6b41-4e9a-bba6-dfaded2b10c0),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:24:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:44.571690 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c4fe8122-957e-4a6e-a78e-348131327f9b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (c74bfff2-6b41-4e9a-bba6-dfaded2b10c0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:44.918150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c4fe8122-957e-4a6e-a78e-348131327f9b None None] Resource Port c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=c74bfff2-6b41-4e9a-bba6-dfaded2b10c0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=c74bfff2-6b41-4e9a-bba6-dfaded2b10c0,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=c74bfff2-6b41-4e9a-bba6-dfaded2b10c0,segment=NetworkSegment(f504d49b-f85a-4d4e-8352-634bdc19d78f),segment_id=f504d49b-f85a-4d4e-8352-634bdc19d78f)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:44.918489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c4fe8122-957e-4a6e-a78e-348131327f9b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (c74bfff2-6b41-4e9a-bba6-dfaded2b10c0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:44.943777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0b9eb5d4-1afd-4229-8144-c5171cd21ba5 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Resource Port deleted: 9d990fa5-a24c-4b14-8c63-0e0506b80887 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:44.944375 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0b9eb5d4-1afd-4229-8144-c5171cd21ba5 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (9d990fa5-a24c-4b14-8c63-0e0506b80887), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:44.944983 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0b9eb5d4-1afd-4229-8144-c5171cd21ba5 tempest-TestMinimumBasicScenario-1716668822 tempest-TestMinimumBasicScenario-1716668822-project] Security group member updated {'2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'} Sep 27 04:24:45.056435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d5a373a3-7eb0-492d-a550-3268d1e326a8","insert","tapc74bfff2-6b",["set",[]],["map",[["attached-mac","fa:16:3e:ae:1d:61"],["iface-id","c74bfff2-6b41-4e9a-bba6-dfaded2b10c0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:45.070337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d5a373a3-7eb0-492d-a550-3268d1e326a8","old",null,["set",[]],null],["","new","tapc74bfff2-6b",27,["map",[["attached-mac","fa:16:3e:ae:1d:61"],["iface-id","c74bfff2-6b41-4e9a-bba6-dfaded2b10c0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:45.146342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f71df539-6c73-484e-89c1-2f3467338974 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:44Z,data_plane_status=None,description='',device_id='2e87ec94-7cc8-45c7-873c-f9438300f7d0',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fe4ecad8-9126-45df-830c-fb2391ce585d,mac_address=fa:16:3e:58:f1:e9,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fe4ecad8-9126-45df-830c-fb2391ce585d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:24:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:45.146723 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f71df539-6c73-484e-89c1-2f3467338974 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (fe4ecad8-9126-45df-830c-fb2391ce585d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:45.648350 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:381 started Sep 27 04:24:45.650806 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d1b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=475000000,duration_sec=775,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:45.651395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:45.651852 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:381 - starting polling. Elapsed:0.004 Sep 27 04:24:45.654805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:45.656860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 9d990fa5-a24c-4b14-8c63-0e0506b80887 not present in bridge br-int Sep 27 04:24:45.657194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:24:45.657479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['9d990fa5-a24c-4b14-8c63-0e0506b80887'] Sep 27 04:24:45.657824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 9d990fa5-a24c-4b14-8c63-0e0506b80887 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:24:45.662126 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:381 - port information retrieved. Elapsed:0.014 Sep 27 04:24:45.662406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', '133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': {'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0'}, 'removed': set(), 'updated': {'53a249dc-eefb-49ff-a291-f2eda1664fe8', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:24:45.662974 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-5a310953-8b80-4c4f-86d4-ab083fbc1003', 'network_id': '5a310953-8b80-4c4f-86d4-ab083fbc1003', 'port_id': 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', 'mac_address': 'fa:16:3e:ae:1d:61', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ace747cf-2ef4-4c62-b777-44656539b2e3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:45.663462 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '53a249dc-eefb-49ff-a291-f2eda1664fe8', 'device_id': '46ce92bd-e4b4-4da1-be51-d7a27f535bec', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '53a249dc-eefb-49ff-a291-f2eda1664fe8', 'mac_address': 'fa:16:3e:ff:61:24', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.15'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:45.667348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:45.667681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 updated. Details: {'device': 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-5a310953-8b80-4c4f-86d4-ab083fbc1003', 'network_id': '5a310953-8b80-4c4f-86d4-ab083fbc1003', 'port_id': 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', 'mac_address': 'fa:16:3e:ae:1d:61', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ace747cf-2ef4-4c62-b777-44656539b2e3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:24:45.668202 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 11 as local vlan for net-id=5a310953-8b80-4c4f-86d4-ab083fbc1003, seg-id=139 Sep 27 04:24:45.671640 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32eb1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4235), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:45.674747 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22d1d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4107)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4235}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:45.675688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc74bfff2-6b, col_values=(('tag', 11),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:45.676400 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapc74bfff2-6b, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:45.677007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapc74bfff2-6b, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:45.686417 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc74bfff2-6b, col_values=(('other_config', {'net_uuid': '5a310953-8b80-4c4f-86d4-ab083fbc1003', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '139'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:45.695864 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d1f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:45.696465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 53a249dc-eefb-49ff-a291-f2eda1664fe8 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:45.696950 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 53a249dc-eefb-49ff-a291-f2eda1664fe8 updated. Details: {'device': '53a249dc-eefb-49ff-a291-f2eda1664fe8', 'device_id': '46ce92bd-e4b4-4da1-be51-d7a27f535bec', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '53a249dc-eefb-49ff-a291-f2eda1664fe8', 'mac_address': 'fa:16:3e:ff:61:24', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.15'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:24:45.698085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-53a249dc-ee, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:45.698673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-53a249dc-ee, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:45.699063 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-53a249dc-ee, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:45.699683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:24:45.700638 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-53a249dc-ee, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:45.701435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:24:45.704581 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d21,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:45.705428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:381 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.043 Sep 27 04:24:45.706307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:24:45.707014 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0'} Sep 27 04:24:45.708453 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:24:45.708896 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:24:45.714934 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:45.789988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0290c9f-1d7e-4c37-993b-e8a61f8c04cb]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:45.791105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:24:45.791637 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:24:45.794118 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:24:45.795331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:24:45.804839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:45.871998 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c29e69a-c442-4f2e-b490-0e207a9adfaf]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:45.872906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:381 - agent port security group processed in 0.210 Sep 27 04:24:45.874003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:45.874462 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 53a249dc-eefb-49ff-a291-f2eda1664fe8 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:46.194865 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f70b5d20-0cd6-40c5-9e8b-e32ef3c6e293 None None] Resource Port e4db657b-a959-4e62-b211-2cb063d743eb updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=e4db657b-a959-4e62-b211-2cb063d743eb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=e4db657b-a959-4e62-b211-2cb063d743eb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:46.195570 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f70b5d20-0cd6-40c5-9e8b-e32ef3c6e293 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (e4db657b-a959-4e62-b211-2cb063d743eb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:46.380379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:46.380379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (c74bfff2-6b41-4e9a-bba6-dfaded2b10c0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:46.481721 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f70b5d20-0cd6-40c5-9e8b-e32ef3c6e293 None None] Resource Port e4db657b-a959-4e62-b211-2cb063d743eb updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=e4db657b-a959-4e62-b211-2cb063d743eb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=e4db657b-a959-4e62-b211-2cb063d743eb,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=e4db657b-a959-4e62-b211-2cb063d743eb,segment=NetworkSegment(26969db0-2998-4ace-a23e-359a5b524a75),segment_id=26969db0-2998-4ace-a23e-359a5b524a75)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:46.482994 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f70b5d20-0cd6-40c5-9e8b-e32ef3c6e293 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (e4db657b-a959-4e62-b211-2cb063d743eb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:47.297776 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '53a249dc-eefb-49ff-a291-f2eda1664fe8'] and devices down [] completed. Sep 27 04:24:47.298415 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:381 - ports processed. Elapsed:1.650 Sep 27 04:24:47.298500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:381 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:1.650 Sep 27 04:24:47.573531 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-517d56b0-635e-4fbe-a25c-3add0b8cef31 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:46Z,data_plane_status=None,description='',device_id='2e87ec94-7cc8-45c7-873c-f9438300f7d0',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a63caa9f-d00b-46f8-b114-8c8c7bc3b115,mac_address=fa:16:3e:a8:7a:35,name='',network_id=5a310953-8b80-4c4f-86d4-ab083fbc1003,numa_affinity_policy=,project_id='4af948c97bfd43789719fb833d38e164',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a63caa9f-d00b-46f8-b114-8c8c7bc3b115),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:24:47Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:47.574173 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-517d56b0-635e-4fbe-a25c-3add0b8cef31 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a63caa9f-d00b-46f8-b114-8c8c7bc3b115), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:47.648816 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:382 started Sep 27 04:24:47.651821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d23,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=476000000,duration_sec=777,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:47.652603 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:47.653098 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:382 - starting polling. Elapsed:0.004 Sep 27 04:24:47.657369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:47.666498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:382 - port information retrieved. Elapsed:0.017 Sep 27 04:24:47.667890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', '133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': set(), 'updated': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:24:47.670108 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'e4db657b-a959-4e62-b211-2cb063d743eb', 'device_id': '46ce92bd-e4b4-4da1-be51-d7a27f535bec', 'network_id': '41cd98f9-b206-4445-9870-d24633bca602', 'port_id': 'e4db657b-a959-4e62-b211-2cb063d743eb', 'mac_address': 'fa:16:3e:06:b0:80', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c8446e81-8757-4a92-bbb2-c6d0f12abe74', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:47.672591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-5a310953-8b80-4c4f-86d4-ab083fbc1003', 'network_id': '5a310953-8b80-4c4f-86d4-ab083fbc1003', 'port_id': 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', 'mac_address': 'fa:16:3e:ae:1d:61', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ace747cf-2ef4-4c62-b777-44656539b2e3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:47.678589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: e4db657b-a959-4e62-b211-2cb063d743eb {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:47.679153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port e4db657b-a959-4e62-b211-2cb063d743eb updated. Details: {'device': 'e4db657b-a959-4e62-b211-2cb063d743eb', 'device_id': '46ce92bd-e4b4-4da1-be51-d7a27f535bec', 'network_id': '41cd98f9-b206-4445-9870-d24633bca602', 'port_id': 'e4db657b-a959-4e62-b211-2cb063d743eb', 'mac_address': 'fa:16:3e:06:b0:80', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c8446e81-8757-4a92-bbb2-c6d0f12abe74', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 27 04:24:47.680352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e4db657b-a9, col_values=(('tag', 10),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:47.680940 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-e4db657b-a9, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:47.681555 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-e4db657b-a9, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:47.701193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e4db657b-a9, col_values=(('other_config', {'net_uuid': '41cd98f9-b206-4445-9870-d24633bca602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '144'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:47.723430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d25,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:47.724001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:47.724487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 updated. Details: {'device': 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-5a310953-8b80-4c4f-86d4-ab083fbc1003', 'network_id': '5a310953-8b80-4c4f-86d4-ab083fbc1003', 'port_id': 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', 'mac_address': 'fa:16:3e:ae:1d:61', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ace747cf-2ef4-4c62-b777-44656539b2e3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Sep 27 04:24:47.725822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc74bfff2-6b, col_values=(('tag', 11),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:47.726403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapc74bfff2-6b, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:47.727085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapc74bfff2-6b, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:47.727671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:24:47.728587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc74bfff2-6b, col_values=(('other_config', {'net_uuid': '5a310953-8b80-4c4f-86d4-ab083fbc1003', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '139', 'tag': '11'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:47.729441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:24:47.733085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d27,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:47.733674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:382 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.064 Sep 27 04:24:47.734210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 2 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:24:47.734667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:24:47.736551 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:24:47.737162 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:24:47.743295 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:47.802519 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ccd44c7c-0275-498c-89d4-e01fd2b8b048 None None] Resource Port e4db657b-a959-4e62-b211-2cb063d743eb updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:47.803150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ccd44c7c-0275-498c-89d4-e01fd2b8b048 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (e4db657b-a959-4e62-b211-2cb063d743eb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:47.821842 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b23a479-6ef1-4aff-bd40-88acf2a9da67]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:47.822450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:382 - agent port security group processed in 0.153 Sep 27 04:24:47.823358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for e4db657b-a959-4e62-b211-2cb063d743eb to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:47.823658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:48.419215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-517d56b0-635e-4fbe-a25c-3add0b8cef31 admin admin] Received resource Port update without any changes: a63caa9f-d00b-46f8-b114-8c8c7bc3b115 {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:24:48.421905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8b03c6a6-2bc5-4335-b12d-9125388180d6 None None] Resource Port fe4ecad8-9126-45df-830c-fb2391ce585d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=fe4ecad8-9126-45df-830c-fb2391ce585d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=fe4ecad8-9126-45df-830c-fb2391ce585d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:48.422285 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8b03c6a6-2bc5-4335-b12d-9125388180d6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (fe4ecad8-9126-45df-830c-fb2391ce585d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:48.644053 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['e4db657b-a959-4e62-b211-2cb063d743eb', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0'] and devices down [] completed. Sep 27 04:24:48.644402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:382 - ports processed. Elapsed:0.996 Sep 27 04:24:48.644736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:382 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.996 Sep 27 04:24:48.791312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8b03c6a6-2bc5-4335-b12d-9125388180d6 None None] Resource Port fe4ecad8-9126-45df-830c-fb2391ce585d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=fe4ecad8-9126-45df-830c-fb2391ce585d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=fe4ecad8-9126-45df-830c-fb2391ce585d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=fe4ecad8-9126-45df-830c-fb2391ce585d,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:48.791724 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8b03c6a6-2bc5-4335-b12d-9125388180d6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (fe4ecad8-9126-45df-830c-fb2391ce585d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:49.007084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-75ad0bb8-21c6-4f2b-81b3-856c0fc9fcdf admin admin] Resource Port deleted: 64ae3c33-5c89-43f1-a306-96b7cf55eb68 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:49.009952 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-75ad0bb8-21c6-4f2b-81b3-856c0fc9fcdf admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (64ae3c33-5c89-43f1-a306-96b7cf55eb68), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:49.649847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:383 started Sep 27 04:24:49.654397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d29,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=477000000,duration_sec=779,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:49.655219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:49.655725 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:383 - starting polling. Elapsed:0.006 Sep 27 04:24:49.658818 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:49.670726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-64ae3c33-5c, col_values=(('tag', 4095),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:49.693228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d2b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:49.695386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['64ae3c33-5c89-43f1-a306-96b7cf55eb68'] Sep 27 04:24:49.700536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:49.727561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["38400a48-6da1-4c3f-b4c5-ef4a39e54250","insert","qr-a63caa9f-d0",["set",[]],["map",[["attached-mac","fa:16:3e:a8:7a:35"],["iface-id","a63caa9f-d00b-46f8-b114-8c8c7bc3b115"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:49.731987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["38400a48-6da1-4c3f-b4c5-ef4a39e54250","old",null,["set",[]],null],["","new","qr-a63caa9f-d0",28,["map",[["attached-mac","fa:16:3e:a8:7a:35"],["iface-id","a63caa9f-d00b-46f8-b114-8c8c7bc3b115"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:49.862025 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[93599e52-3c7f-40a8-91f4-18561039e2c4]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:49.867544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:383 - port information retrieved. Elapsed:0.218 Sep 27 04:24:49.867895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', '133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'afdb5bd9-6267-4259-a055-9a22757a36e0', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '64ae3c33-5c89-43f1-a306-96b7cf55eb68', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': set(), 'updated': {'e4db657b-a959-4e62-b211-2cb063d743eb'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:24:49.868470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'e4db657b-a959-4e62-b211-2cb063d743eb', 'device_id': '46ce92bd-e4b4-4da1-be51-d7a27f535bec', 'network_id': '41cd98f9-b206-4445-9870-d24633bca602', 'port_id': 'e4db657b-a959-4e62-b211-2cb063d743eb', 'mac_address': 'fa:16:3e:06:b0:80', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c8446e81-8757-4a92-bbb2-c6d0f12abe74', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:49.877208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: e4db657b-a959-4e62-b211-2cb063d743eb {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:49.877554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port e4db657b-a959-4e62-b211-2cb063d743eb updated. Details: {'device': 'e4db657b-a959-4e62-b211-2cb063d743eb', 'device_id': '46ce92bd-e4b4-4da1-be51-d7a27f535bec', 'network_id': '41cd98f9-b206-4445-9870-d24633bca602', 'port_id': 'e4db657b-a959-4e62-b211-2cb063d743eb', 'mac_address': 'fa:16:3e:06:b0:80', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c8446e81-8757-4a92-bbb2-c6d0f12abe74', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 27 04:24:49.878824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e4db657b-a9, col_values=(('tag', 10),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:49.879255 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-e4db657b-a9, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:49.879718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-e4db657b-a9, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:49.886571 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:24:49.891545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e4db657b-a9, col_values=(('other_config', {'net_uuid': '41cd98f9-b206-4445-9870-d24633bca602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '144', 'tag': '10'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:49.892479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:24:49.899706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d2d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:49.901259 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:383 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.033 Sep 27 04:24:49.902062 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:24:49.903695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:24:49.905057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:24:49.908012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:24:49.914433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:49.977654 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e88f9ec-5ad1-4fde-bdf0-cee353979442]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:49.978993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:383 - agent port security group processed in 0.111 Sep 27 04:24:49.979928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for e4db657b-a959-4e62-b211-2cb063d743eb to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:50.068850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c31b3392-a2c4-4834-bc3a-f9aa6e21b04a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource Port deleted: ef3b9eed-fccf-490a-bc0f-2fe41f79b621 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:50.069456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c31b3392-a2c4-4834-bc3a-f9aa6e21b04a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (ef3b9eed-fccf-490a-bc0f-2fe41f79b621), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:50.070059 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c31b3392-a2c4-4834-bc3a-f9aa6e21b04a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group member updated {'62743add-abd0-40c3-a1bc-b77cc5f58cd6'} Sep 27 04:24:50.104962 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a392439b-ffb7-4008-b190-56ada5d5335e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:24:49Z,description='tempest-secgroup-smoke-1351616088 description',id=ed46206f-12d5-4819-aa08-0f95f9ac185f,is_default=False,name='tempest-secgroup-smoke-1351616088',project_id='1e595829629a4dd4a7fccbdabc896cb0',revision_number=1,rules=[SecurityGroupRule(0b55560f-1b4f-4619-93b3-0a7f02584dd0),SecurityGroupRule(464f31e3-84d9-4da0-a8ca-c8dc1644e35e)],shared=False,stateful=True,updated_at=2022-09-27T04:24:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:50.105353 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a392439b-ffb7-4008-b190-56ada5d5335e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (ed46206f-12d5-4819-aa08-0f95f9ac185f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:50.106009 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a392439b-ffb7-4008-b190-56ada5d5335e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:49Z,description=,direction='egress',ethertype='IPv4',id=0b55560f-1b4f-4619-93b3-0a7f02584dd0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed46206f-12d5-4819-aa08-0f95f9ac185f,updated_at=2022-09-27T04:24:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:50.106630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a392439b-ffb7-4008-b190-56ada5d5335e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0b55560f-1b4f-4619-93b3-0a7f02584dd0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:50.106760 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a392439b-ffb7-4008-b190-56ada5d5335e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:24:50.107621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a392439b-ffb7-4008-b190-56ada5d5335e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:49Z,description=,direction='egress',ethertype='IPv6',id=464f31e3-84d9-4da0-a8ca-c8dc1644e35e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed46206f-12d5-4819-aa08-0f95f9ac185f,updated_at=2022-09-27T04:24:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:50.108345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a392439b-ffb7-4008-b190-56ada5d5335e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (464f31e3-84d9-4da0-a8ca-c8dc1644e35e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:50.108853 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a392439b-ffb7-4008-b190-56ada5d5335e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:24:50.223676 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['e4db657b-a959-4e62-b211-2cb063d743eb'] and devices down [] completed. Sep 27 04:24:50.224000 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:383 - ports processed. Elapsed:0.574 Sep 27 04:24:50.224339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:383 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.575 Sep 27 04:24:50.426985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["35e85150-41a1-423f-99a7-531c056d8edd","insert","qg-fe4ecad8-91",["set",[]],["map",[["attached-mac","fa:16:3e:58:f1:e9"],["iface-id","fe4ecad8-9126-45df-830c-fb2391ce585d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:50.472237 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["35e85150-41a1-423f-99a7-531c056d8edd","old",null,["set",[]],null],["","new","qg-fe4ecad8-91",29,["map",[["attached-mac","fa:16:3e:58:f1:e9"],["iface-id","fe4ecad8-9126-45df-830c-fb2391ce585d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:50.576476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aa988e3d-5dca-4a22-aef6-924aa08f89b4","delete","qr-64ae3c33-5c",19,["map",[["attached-mac","fa:16:3e:fc:db:59"],["iface-id","64ae3c33-5c89-43f1-a306-96b7cf55eb68"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:50.583142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1717753b-9cf5-47a0-9c12-e77963ca0d14 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:50Z,description='',direction='ingress',ethertype='IPv4',id=d3b4b24a-3c98-4534-b0b0-b10f46cb790a,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed46206f-12d5-4819-aa08-0f95f9ac185f,updated_at=2022-09-27T04:24:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:50.583800 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1717753b-9cf5-47a0-9c12-e77963ca0d14 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d3b4b24a-3c98-4534-b0b0-b10f46cb790a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:50.584833 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1717753b-9cf5-47a0-9c12-e77963ca0d14 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:24:50.865509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6848a783-f00a-4f84-9a91-79fa8e537ef6 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:50Z,description='',direction='egress',ethertype='IPv4',id=a0b28a24-5c19-4d18-b033-de0f89741aee,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed46206f-12d5-4819-aa08-0f95f9ac185f,updated_at=2022-09-27T04:24:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:50.866620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6848a783-f00a-4f84-9a91-79fa8e537ef6 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a0b28a24-5c19-4d18-b033-de0f89741aee), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:50.866988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6848a783-f00a-4f84-9a91-79fa8e537ef6 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:24:50.944772 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-28c7b2a5-2710-45a8-9643-7f8c282a153b admin admin] Resource Port deleted: afdb5bd9-6267-4259-a055-9a22757a36e0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:50.945256 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-28c7b2a5-2710-45a8-9643-7f8c282a153b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (afdb5bd9-6267-4259-a055-9a22757a36e0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:51.127300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4fe52d00-b14c-49bf-9204-b0b990dd6fa0","delete","qg-afdb5bd9-62",20,["map",[["attached-mac","fa:16:3e:af:cd:fc"],["iface-id","afdb5bd9-6267-4259-a055-9a22757a36e0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:51.133336 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5ea12b22-2e60-4474-bdcf-8f6c030c33e2 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:51Z,description='',direction='ingress',ethertype='IPv4',id=619563f9-61bd-4994-877d-298a30c43755,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed46206f-12d5-4819-aa08-0f95f9ac185f,updated_at=2022-09-27T04:24:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:51.133726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5ea12b22-2e60-4474-bdcf-8f6c030c33e2 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (619563f9-61bd-4994-877d-298a30c43755), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:51.134222 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5ea12b22-2e60-4474-bdcf-8f6c030c33e2 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:24:51.433445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a7ccc1c3-bceb-4eb7-a813-9e443217f0ca tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:51Z,description='',direction='egress',ethertype='IPv4',id=b53a6263-f24b-4dc9-b49f-52148e56e6d5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed46206f-12d5-4819-aa08-0f95f9ac185f,updated_at=2022-09-27T04:24:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:51.434020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a7ccc1c3-bceb-4eb7-a813-9e443217f0ca tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b53a6263-f24b-4dc9-b49f-52148e56e6d5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:51.434575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a7ccc1c3-bceb-4eb7-a813-9e443217f0ca tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:24:51.630541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fd9d12b1-1ffd-468e-9077-bbbdff939b3e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:51Z,description='',direction='ingress',ethertype='IPv6',id=33b32542-6f7c-4172-b5a3-184202a6d272,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed46206f-12d5-4819-aa08-0f95f9ac185f,updated_at=2022-09-27T04:24:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:51.631659 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fd9d12b1-1ffd-468e-9077-bbbdff939b3e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (33b32542-6f7c-4172-b5a3-184202a6d272), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:51.632481 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fd9d12b1-1ffd-468e-9077-bbbdff939b3e tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:24:51.650271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:384 started Sep 27 04:24:51.653042 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d2f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=477000000,duration_sec=781,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:51.653629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:51.654306 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:384 - starting polling. Elapsed:0.004 Sep 27 04:24:51.657820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:51.659477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ef3b9eed-fccf-490a-bc0f-2fe41f79b621 not present in bridge br-int Sep 27 04:24:51.659812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:24:51.660100 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['ef3b9eed-fccf-490a-bc0f-2fe41f79b621'] Sep 27 04:24:51.660692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ef3b9eed-fccf-490a-bc0f-2fe41f79b621 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:24:51.679411 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d31,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:51.682585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d33,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:51.682901 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:384 - port information retrieved. Elapsed:0.033 Sep 27 04:24:51.683239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', '133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'ae327828-ee82-4fa3-8699-6f3a43b0bdf1', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': {'fe4ecad8-9126-45df-830c-fb2391ce585d', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115'}, 'removed': {'afdb5bd9-6267-4259-a055-9a22757a36e0', '64ae3c33-5c89-43f1-a306-96b7cf55eb68'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:24:51.683832 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'device_id': '2e87ec94-7cc8-45c7-873c-f9438300f7d0', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'mac_address': 'fa:16:3e:58:f1:e9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.92'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:51.684444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:46Z,data_plane_status=None,description='',device_id='2e87ec94-7cc8-45c7-873c-f9438300f7d0',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a63caa9f-d00b-46f8-b114-8c8c7bc3b115,mac_address=fa:16:3e:a8:7a:35,name='',network_id=5a310953-8b80-4c4f-86d4-ab083fbc1003,numa_affinity_policy=,project_id='4af948c97bfd43789719fb833d38e164',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(a63caa9f-d00b-46f8-b114-8c8c7bc3b115),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:24:48Z) is not bound. Sep 27 04:24:51.690611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: fe4ecad8-9126-45df-830c-fb2391ce585d {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:51.691067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port fe4ecad8-9126-45df-830c-fb2391ce585d updated. Details: {'device': 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'device_id': '2e87ec94-7cc8-45c7-873c-f9438300f7d0', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'mac_address': 'fa:16:3e:58:f1:e9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.92'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:24:51.692180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-fe4ecad8-91, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:51.692749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-fe4ecad8-91, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:51.693409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-fe4ecad8-91, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:51.703802 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-fe4ecad8-91, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:51.715108 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d35,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:51.715814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: a63caa9f-d00b-46f8-b114-8c8c7bc3b115 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:51.716318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device a63caa9f-d00b-46f8-b114-8c8c7bc3b115 not defined on plugin or binding failed Sep 27 04:24:51.717035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:384 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.033 Sep 27 04:24:51.718597 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 2 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:24:51.719012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'fe4ecad8-9126-45df-830c-fb2391ce585d', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115'} Sep 27 04:24:51.720878 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:24:51.721277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:24:51.728437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:51.781440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[214aa6a3-ad60-4aff-a1bc-0b3c6a787e43]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:51.782112 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:384 - agent port security group processed in 0.098 Sep 27 04:24:51.783044 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for fe4ecad8-9126-45df-830c-fb2391ce585d to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:51.835090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c618e83e-df89-4840-b9f0-8f1db43844c2 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:51Z,description='',direction='egress',ethertype='IPv6',id=9a94e02b-9ab1-4598-a7fa-26b38f04cd9b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e595829629a4dd4a7fccbdabc896cb0',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed46206f-12d5-4819-aa08-0f95f9ac185f,updated_at=2022-09-27T04:24:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:51.835512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c618e83e-df89-4840-b9f0-8f1db43844c2 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9a94e02b-9ab1-4598-a7fa-26b38f04cd9b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:51.837789 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c618e83e-df89-4840-b9f0-8f1db43844c2 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:24:51.866201 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-776f3833-2b0c-4dd7-ac63-01fbc9d9d4e6 admin admin] Resource Subnet deleted: fd63d32a-4d29-4e2e-ae4d-0ed8efa71b40 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:51.866785 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-776f3833-2b0c-4dd7-ac63-01fbc9d9d4e6 admin admin] Publish callbacks [] for Subnet (fd63d32a-4d29-4e2e-ae4d-0ed8efa71b40), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:52.071154 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cc39a407-3803-47ac-b1f6-fd7de0e5a692","delete","tapae327828-ee",18,["map",[["attached-mac","fa:16:3e:36:fb:05"],["iface-id","ae327828-ee82-4fa3-8699-6f3a43b0bdf1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:52.127955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['fe4ecad8-9126-45df-830c-fb2391ce585d'] and devices down [] completed. Sep 27 04:24:52.128944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'afdb5bd9-6267-4259-a055-9a22757a36e0', '64ae3c33-5c89-43f1-a306-96b7cf55eb68'} Sep 27 04:24:52.129670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 64ae3c33-5c89-43f1-a306-96b7cf55eb68 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:24:52.130524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:52.199568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5439c78-38d9-4d23-9f19-9ab15130ce56]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:52.200358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'afdb5bd9-6267-4259-a055-9a22757a36e0', '64ae3c33-5c89-43f1-a306-96b7cf55eb68'} removed Sep 27 04:24:52.309968 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port fe4ecad8-9126-45df-830c-fb2391ce585d updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=fe4ecad8-9126-45df-830c-fb2391ce585d,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=fe4ecad8-9126-45df-830c-fb2391ce585d,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:52.310929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (fe4ecad8-9126-45df-830c-fb2391ce585d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:52.371249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:24:52.372500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:24:52.373039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:384 - treat_devices_removed completed in 0.244 Sep 27 04:24:52.373561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:384 - ports processed. Elapsed:0.723 Sep 27 04:24:52.374129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:384 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 2}}. Elapsed:0.724 Sep 27 04:24:52.695464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-345f9ba8-3f09-4473-bb3d-c28816952738 None None] Resource Port deleted: ae327828-ee82-4fa3-8699-6f3a43b0bdf1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:52.695959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-345f9ba8-3f09-4473-bb3d-c28816952738 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (ae327828-ee82-4fa3-8699-6f3a43b0bdf1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:52.699964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-780f9c30-7ab7-4d31-9294-2b12e2694d54 admin admin] Resource Port deleted: ae327828-ee82-4fa3-8699-6f3a43b0bdf1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:52.701777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-780f9c30-7ab7-4d31-9294-2b12e2694d54 admin admin] Skipped duplicate delete event for ae327828-ee82-4fa3-8699-6f3a43b0bdf1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 27 04:24:53.013201 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-780f9c30-7ab7-4d31-9294-2b12e2694d54 admin admin] Resource Network deleted: 8bc82a56-69c2-484f-aa08-23831b7e71a2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:53.013875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-780f9c30-7ab7-4d31-9294-2b12e2694d54 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (8bc82a56-69c2-484f-aa08-23831b7e71a2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:53.652278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:385 started Sep 27 04:24:53.656328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d37,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=479000000,duration_sec=783,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:53.657058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:53.657618 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:385 - starting polling. Elapsed:0.006 Sep 27 04:24:53.663671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:53.676406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d39,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:53.676874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:385 - port information retrieved. Elapsed:0.025 Sep 27 04:24:53.677383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', '133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '854192e1-9dfd-42be-9854-8eaac296377e', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0', '3a195ca1-f95a-4b00-b874-500af40a79fd', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', '9f7dbaf8-9996-41f1-91fd-9755032671f2', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': {'ae327828-ee82-4fa3-8699-6f3a43b0bdf1'}, 'updated': {'fe4ecad8-9126-45df-830c-fb2391ce585d'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:24:53.678765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'device_id': '2e87ec94-7cc8-45c7-873c-f9438300f7d0', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'mac_address': 'fa:16:3e:58:f1:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.92'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:53.684007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: fe4ecad8-9126-45df-830c-fb2391ce585d {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:53.684489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port fe4ecad8-9126-45df-830c-fb2391ce585d updated. Details: {'device': 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'device_id': '2e87ec94-7cc8-45c7-873c-f9438300f7d0', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'mac_address': 'fa:16:3e:58:f1:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.92'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:24:53.686248 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-fe4ecad8-91, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:53.687025 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-fe4ecad8-91, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:53.687656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-fe4ecad8-91, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:53.716545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:24:53.717973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-fe4ecad8-91, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:53.719712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:24:53.727216 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d3b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:53.727913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:385 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.050 Sep 27 04:24:53.728437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:24:53.729032 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:24:53.730988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:24:53.731528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:24:53.738249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:53.789317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bb490a-5f38-469f-8571-0863b995ba44]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:53.790885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:385 - agent port security group processed in 0.113 Sep 27 04:24:53.791870 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for fe4ecad8-9126-45df-830c-fb2391ce585d to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:53.944137 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['fe4ecad8-9126-45df-830c-fb2391ce585d'] and devices down [] completed. Sep 27 04:24:53.944462 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'ae327828-ee82-4fa3-8699-6f3a43b0bdf1'} Sep 27 04:24:53.945085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:53.996430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c296a4d-4997-4915-b567-f6a6b269442e]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:53.997202 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'ae327828-ee82-4fa3-8699-6f3a43b0bdf1'} removed Sep 27 04:24:54.028272 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource SecurityGroup deleted: 62743add-abd0-40c3-a1bc-b77cc5f58cd6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:54.028859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (62743add-abd0-40c3-a1bc-b77cc5f58cd6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:54.029298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('62743add-abd0-40c3-a1bc-b77cc5f58cd6',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:24:54.046706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:24:54.047463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 8 from net-id = 8bc82a56-69c2-484f-aa08-23831b7e71a2, seg-id = 134 Sep 27 04:24:54.054709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('62743add-abd0-40c3-a1bc-b77cc5f58cd6',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:24:54.055724 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource SecurityGroupRule deleted: 0f2dffd0-f8a5-4d8e-9961-09a1f8e20ccf {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:54.056497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0f2dffd0-f8a5-4d8e-9961-09a1f8e20ccf), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:54.056942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['62743add-abd0-40c3-a1bc-b77cc5f58cd6'] Sep 27 04:24:54.057649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource SecurityGroupRule deleted: b26cdee8-16b3-4b4d-8cc1-2e793e4dff05 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:54.058138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b26cdee8-16b3-4b4d-8cc1-2e793e4dff05), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:54.058595 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['62743add-abd0-40c3-a1bc-b77cc5f58cd6'] Sep 27 04:24:54.059813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource SecurityGroupRule deleted: 2e359b6a-a9dc-400c-be5e-552284a73496 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:54.060444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2e359b6a-a9dc-400c-be5e-552284a73496), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:54.061016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['62743add-abd0-40c3-a1bc-b77cc5f58cd6'] Sep 27 04:24:54.062303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource SecurityGroupRule deleted: e07b7bea-2d17-4e16-b75b-ca2c8a8d0a5f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:54.062922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e07b7bea-2d17-4e16-b75b-ca2c8a8d0a5f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:54.063738 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c4a75785-305e-42c5-b9d7-803fc00e086e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['62743add-abd0-40c3-a1bc-b77cc5f58cd6'] Sep 27 04:24:54.067123 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32eb3,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:54.074051 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc22d3d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4230}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:54.074742 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:385 - treat_devices_removed completed in 0.130 Sep 27 04:24:54.075898 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:385 - ports processed. Elapsed:0.423 Sep 27 04:24:54.076508 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:385 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 1}}. Elapsed:0.424 Sep 27 04:24:54.422059 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-57ab4463-dc8d-40f8-818a-bc9e8e87f9e5 admin admin] Resource Port deleted: ed0a7ee1-975d-4612-a2f5-84b7920a09a0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:54.429541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-57ab4463-dc8d-40f8-818a-bc9e8e87f9e5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (ed0a7ee1-975d-4612-a2f5-84b7920a09a0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:54.459863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a5722e59-72db-4d89-b97b-16401c3a1d79 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource Port deleted: ab414d11-ac61-465d-b26b-bf3568c658c0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:54.460487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a5722e59-72db-4d89-b97b-16401c3a1d79 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (ab414d11-ac61-465d-b26b-bf3568c658c0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:55.050425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f24a3a9b-467f-49f5-a0b3-4e6f5f030941 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:24:54Z,description='tempest-description--1353863950',id=54bc43f8-7528-41d7-83a2-7be375d773a9,is_default=False,name='tempest-securitygroup--2137855252',project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',revision_number=1,rules=[SecurityGroupRule(4e77d63a-b6fb-4476-9c5a-f8dc4233fb84),SecurityGroupRule(f8238ebc-b648-454b-be62-31f817d8068a)],shared=False,stateful=True,updated_at=2022-09-27T04:24:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:55.053988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f24a3a9b-467f-49f5-a0b3-4e6f5f030941 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (54bc43f8-7528-41d7-83a2-7be375d773a9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:55.054387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f24a3a9b-467f-49f5-a0b3-4e6f5f030941 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:54Z,description=,direction='egress',ethertype='IPv4',id=4e77d63a-b6fb-4476-9c5a-f8dc4233fb84,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=54bc43f8-7528-41d7-83a2-7be375d773a9,updated_at=2022-09-27T04:24:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:55.054775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f24a3a9b-467f-49f5-a0b3-4e6f5f030941 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4e77d63a-b6fb-4476-9c5a-f8dc4233fb84), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:55.055204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f24a3a9b-467f-49f5-a0b3-4e6f5f030941 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['54bc43f8-7528-41d7-83a2-7be375d773a9'] Sep 27 04:24:55.055980 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f24a3a9b-467f-49f5-a0b3-4e6f5f030941 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:54Z,description=,direction='egress',ethertype='IPv6',id=f8238ebc-b648-454b-be62-31f817d8068a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=54bc43f8-7528-41d7-83a2-7be375d773a9,updated_at=2022-09-27T04:24:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:55.056350 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f24a3a9b-467f-49f5-a0b3-4e6f5f030941 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f8238ebc-b648-454b-be62-31f817d8068a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:55.056685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f24a3a9b-467f-49f5-a0b3-4e6f5f030941 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['54bc43f8-7528-41d7-83a2-7be375d773a9'] Sep 27 04:24:55.227191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-83e009ad-c41c-474d-8125-e9730056112e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:55Z,description='',direction='ingress',ethertype='IPv4',id=973e04f0-c771-4abd-8fff-d9372044561f,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=54bc43f8-7528-41d7-83a2-7be375d773a9,updated_at=2022-09-27T04:24:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:55.228789 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-83e009ad-c41c-474d-8125-e9730056112e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (973e04f0-c771-4abd-8fff-d9372044561f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:55.229148 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-83e009ad-c41c-474d-8125-e9730056112e tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['54bc43f8-7528-41d7-83a2-7be375d773a9'] Sep 27 04:24:55.403438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f55de6b9-8ad9-4319-b0a3-c6bd020e2af5 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:24:55Z,description='',direction='ingress',ethertype='IPv4',id=74b8518a-e3ce-4176-97e0-48fb05e2cb02,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=54bc43f8-7528-41d7-83a2-7be375d773a9,updated_at=2022-09-27T04:24:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:55.404934 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f55de6b9-8ad9-4319-b0a3-c6bd020e2af5 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (74b8518a-e3ce-4176-97e0-48fb05e2cb02), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:55.405289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f55de6b9-8ad9-4319-b0a3-c6bd020e2af5 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['54bc43f8-7528-41d7-83a2-7be375d773a9'] Sep 27 04:24:55.653138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:386 started Sep 27 04:24:55.656888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d3f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=480000000,duration_sec=785,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:55.657856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:55.658600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:386 - starting polling. Elapsed:0.006 Sep 27 04:24:55.663393 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:55.665461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ab414d11-ac61-465d-b26b-bf3568c658c0 not present in bridge br-int Sep 27 04:24:55.665820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:24:55.675572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-ed0a7ee1-97, col_values=(('tag', 4095),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:55.692611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d41,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:55.693023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['ab414d11-ac61-465d-b26b-bf3568c658c0', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0'] Sep 27 04:24:55.693353 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ab414d11-ac61-465d-b26b-bf3568c658c0 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:24:55.694557 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:55.776727 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9520b8-7b84-4f09-bd8f-4423e2427e1c]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:55.781004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:386 - port information retrieved. Elapsed:0.128 Sep 27 04:24:55.781562 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:386 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.129 Sep 27 04:24:56.064463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-43cc629f-b5c2-405e-8388-86c12a237f30 admin admin] Resource Port deleted: 9f7dbaf8-9996-41f1-91fd-9755032671f2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:56.065085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-43cc629f-b5c2-405e-8388-86c12a237f30 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (9f7dbaf8-9996-41f1-91fd-9755032671f2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:56.094445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ab60ee1f-16b2-4d9f-9a1c-cb30ecb4360d tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:24:55Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=66da99a4-6b5d-4100-a1d8-03fd29f87923,mac_address=fa:16:3e:03:39:a0,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(66da99a4-6b5d-4100-a1d8-03fd29f87923),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:24:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:24:56.094821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ab60ee1f-16b2-4d9f-9a1c-cb30ecb4360d tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (66da99a4-6b5d-4100-a1d8-03fd29f87923), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:56.151758 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["233da85b-1d48-444d-88ed-e14def6f521e","delete","qr-ed0a7ee1-97",22,["map",[["attached-mac","fa:16:3e:9f:35:0f"],["iface-id","ed0a7ee1-975d-4612-a2f5-84b7920a09a0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:56.208279 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-96eb3e66-8f05-47a8-a6dc-db6c5e4977a6 None None] Resource Port a63caa9f-d00b-46f8-b114-8c8c7bc3b115 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=a63caa9f-d00b-46f8-b114-8c8c7bc3b115,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=a63caa9f-d00b-46f8-b114-8c8c7bc3b115,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:56.209007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-96eb3e66-8f05-47a8-a6dc-db6c5e4977a6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a63caa9f-d00b-46f8-b114-8c8c7bc3b115), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:56.491358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-96eb3e66-8f05-47a8-a6dc-db6c5e4977a6 None None] Resource Port a63caa9f-d00b-46f8-b114-8c8c7bc3b115 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=a63caa9f-d00b-46f8-b114-8c8c7bc3b115,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=a63caa9f-d00b-46f8-b114-8c8c7bc3b115,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=a63caa9f-d00b-46f8-b114-8c8c7bc3b115,segment=NetworkSegment(f504d49b-f85a-4d4e-8352-634bdc19d78f),segment_id=f504d49b-f85a-4d4e-8352-634bdc19d78f)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:56.491860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-96eb3e66-8f05-47a8-a6dc-db6c5e4977a6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a63caa9f-d00b-46f8-b114-8c8c7bc3b115), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:56.583883 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["64a2c4f0-8d57-40f5-ad69-d671fa2d657f","delete","qg-9f7dbaf8-99",23,["map",[["attached-mac","fa:16:3e:ab:79:4c"],["iface-id","9f7dbaf8-9996-41f1-91fd-9755032671f2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:56.685956 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ab60ee1f-16b2-4d9f-9a1c-cb30ecb4360d tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource Port 66da99a4-6b5d-4100-a1d8-03fd29f87923 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'c620c6e8-1644-41ec-86f6-ade51117f4e1'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:56.686585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ab60ee1f-16b2-4d9f-9a1c-cb30ecb4360d tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (66da99a4-6b5d-4100-a1d8-03fd29f87923), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:56.892687 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2eddda98-6c85-40d4-b45b-3504d2af631f admin admin] Resource Subnet deleted: 35f4deae-7512-4fb1-9c36-36796c3f5f81 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:56.893404 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2eddda98-6c85-40d4-b45b-3504d2af631f admin admin] Publish callbacks [] for Subnet (35f4deae-7512-4fb1-9c36-36796c3f5f81), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:57.020698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-19cc0148-91e3-40f1-8680-91a7476fc670 None None] Resource Port a63caa9f-d00b-46f8-b114-8c8c7bc3b115 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:24:57.021906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-19cc0148-91e3-40f1-8680-91a7476fc670 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a63caa9f-d00b-46f8-b114-8c8c7bc3b115), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:57.104606 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c33d924c-8d17-41ce-9c49-40da0020805b","delete","tap854192e1-9d",21,["map",[["attached-mac","fa:16:3e:47:49:7a"],["iface-id","854192e1-9dfd-42be-9854-8eaac296377e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:24:57.493839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3b02c53a-a507-478e-8f45-81f84972a590 admin admin] Resource Port deleted: 854192e1-9dfd-42be-9854-8eaac296377e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:57.496816 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3b02c53a-a507-478e-8f45-81f84972a590 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (854192e1-9dfd-42be-9854-8eaac296377e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:57.515327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-04a94bd1-dbd1-4235-a3c6-5e075a2dc7c8 None None] Resource Port deleted: 854192e1-9dfd-42be-9854-8eaac296377e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:57.515663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-04a94bd1-dbd1-4235-a3c6-5e075a2dc7c8 None None] Skipped duplicate delete event for 854192e1-9dfd-42be-9854-8eaac296377e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 27 04:24:57.653591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:387 started Sep 27 04:24:57.656624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d43,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=481000000,duration_sec=787,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:57.657180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:57.657674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:387 - starting polling. Elapsed:0.004 Sep 27 04:24:57.666385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:57.684474 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d45,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:57.691559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d47,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:57.695861 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d49,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:57.697084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:387 - port information retrieved. Elapsed:0.044 Sep 27 04:24:57.697657 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', '133717b2-0788-457d-9fba-bcfb1664cf21', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '3a195ca1-f95a-4b00-b874-500af40a79fd', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': {'9f7dbaf8-9996-41f1-91fd-9755032671f2', '854192e1-9dfd-42be-9854-8eaac296377e', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0'}, 'updated': {'a63caa9f-d00b-46f8-b114-8c8c7bc3b115'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:24:57.698540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'device_id': '2e87ec94-7cc8-45c7-873c-f9438300f7d0', 'network_id': '5a310953-8b80-4c4f-86d4-ab083fbc1003', 'port_id': 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'mac_address': 'fa:16:3e:a8:7a:35', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ace747cf-2ef4-4c62-b777-44656539b2e3', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:24:57.704592 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: a63caa9f-d00b-46f8-b114-8c8c7bc3b115 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:24:57.705755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port a63caa9f-d00b-46f8-b114-8c8c7bc3b115 updated. Details: {'device': 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'device_id': '2e87ec94-7cc8-45c7-873c-f9438300f7d0', 'network_id': '5a310953-8b80-4c4f-86d4-ab083fbc1003', 'port_id': 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'mac_address': 'fa:16:3e:a8:7a:35', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ace747cf-2ef4-4c62-b777-44656539b2e3', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Sep 27 04:24:57.708158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a63caa9f-d0, col_values=(('tag', 11),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:57.708854 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-a63caa9f-d0, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:57.710109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-a63caa9f-d0, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:57.722397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a63caa9f-d0, col_values=(('other_config', {'net_uuid': '5a310953-8b80-4c4f-86d4-ab083fbc1003', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '139'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:24:57.734843 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d4b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:57.735878 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:387 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.037 Sep 27 04:24:57.736724 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:24:57.737251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:24:57.739403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:24:57.739913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:24:57.745698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:57.816480 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bd07d7-2b72-4818-95df-d75263c27664]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:57.819941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:387 - agent port security group processed in 0.122 Sep 27 04:24:57.821028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for a63caa9f-d00b-46f8-b114-8c8c7bc3b115 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:24:57.993902 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3b02c53a-a507-478e-8f45-81f84972a590 admin admin] Resource Network deleted: dfbfe995-da26-4e0f-85ea-0bd48f57c792 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:57.993902 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3b02c53a-a507-478e-8f45-81f84972a590 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (dfbfe995-da26-4e0f-85ea-0bd48f57c792), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:58.170284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['a63caa9f-d00b-46f8-b114-8c8c7bc3b115'] and devices down [] completed. Sep 27 04:24:58.171451 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'9f7dbaf8-9996-41f1-91fd-9755032671f2', '854192e1-9dfd-42be-9854-8eaac296377e', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0'} Sep 27 04:24:58.172332 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ed0a7ee1-975d-4612-a2f5-84b7920a09a0 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:24:58.173228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 8 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:24:58.241247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d00b6f-1217-4510-9f9e-c3302dc5b4bd]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:24:58.243277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'9f7dbaf8-9996-41f1-91fd-9755032671f2', '854192e1-9dfd-42be-9854-8eaac296377e', 'ed0a7ee1-975d-4612-a2f5-84b7920a09a0'} removed Sep 27 04:24:58.370037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:24:58.370738 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 9 from net-id = dfbfe995-da26-4e0f-85ea-0bd48f57c792, seg-id = 146 Sep 27 04:24:58.375105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32eb5,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:58.378477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc22d4d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4242}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:58.380618 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:24:58.381085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:387 - treat_devices_removed completed in 0.210 Sep 27 04:24:58.382074 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:387 - ports processed. Elapsed:0.729 Sep 27 04:24:58.382572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:387 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 3}}. Elapsed:0.729 Sep 27 04:24:58.496780 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Resource SecurityGroup deleted: 2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:58.497548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:58.498473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:24:58.517048 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:24:58.518116 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Resource SecurityGroupRule deleted: 47250827-9138-4f13-8f81-4c5147609fce {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:58.518733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (47250827-9138-4f13-8f81-4c5147609fce), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:58.519354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Security group rule updated ['2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'] Sep 27 04:24:58.520026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Resource SecurityGroupRule deleted: bbe127b5-2281-48f8-b9ee-f1fc4cebf5a5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:58.520603 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (bbe127b5-2281-48f8-b9ee-f1fc4cebf5a5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:58.522012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Security group rule updated ['2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'] Sep 27 04:24:58.522539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Resource SecurityGroupRule deleted: c3151354-81f8-48cb-82d2-3d5ab76bbdfe {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:58.523631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c3151354-81f8-48cb-82d2-3d5ab76bbdfe), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:58.524278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Security group rule updated ['2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'] Sep 27 04:24:58.524964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Resource SecurityGroupRule deleted: de098977-6032-41fc-8b97-14e72c891fa7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:58.525509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (de098977-6032-41fc-8b97-14e72c891fa7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:58.526136 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-26848a5b-1f0c-49f2-a122-cda5f5d511dc admin admin] Security group rule updated ['2dfa253e-6eff-43f5-a9f9-cec1bf9c0f66'] Sep 27 04:24:59.150537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Resource SecurityGroup deleted: 5fced9ee-33f6-413a-8761-efe988f6ef5a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:59.150813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (5fced9ee-33f6-413a-8761-efe988f6ef5a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:59.151270 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5fced9ee-33f6-413a-8761-efe988f6ef5a',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:24:59.176964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5fced9ee-33f6-413a-8761-efe988f6ef5a',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:24:59.179691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Resource SecurityGroupRule deleted: 43125dc7-25b6-4588-a1bc-5c070f9a8778 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:59.180498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (43125dc7-25b6-4588-a1bc-5c070f9a8778), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:59.181636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Security group rule updated ['5fced9ee-33f6-413a-8761-efe988f6ef5a'] Sep 27 04:24:59.181636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Resource SecurityGroupRule deleted: 6661a9ce-58e7-476c-a3f5-7e5262e397ea {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:59.182170 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6661a9ce-58e7-476c-a3f5-7e5262e397ea), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:59.182504 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Security group rule updated ['5fced9ee-33f6-413a-8761-efe988f6ef5a'] Sep 27 04:24:59.182915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Resource SecurityGroupRule deleted: 7d5ec4cd-14f9-4cea-b532-e4687a2bb956 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:59.183257 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7d5ec4cd-14f9-4cea-b532-e4687a2bb956), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:59.188776 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Security group rule updated ['5fced9ee-33f6-413a-8761-efe988f6ef5a'] Sep 27 04:24:59.190926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Resource SecurityGroupRule deleted: fdd4a177-b6b6-4cf4-9bce-dbf8d6f1ec1a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:24:59.192186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (fdd4a177-b6b6-4cf4-9bce-dbf8d6f1ec1a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:24:59.193058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c8740c9-f7b6-48bb-8da3-9fadbfac2621 admin admin] Security group rule updated ['5fced9ee-33f6-413a-8761-efe988f6ef5a'] Sep 27 04:24:59.654912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:388 started Sep 27 04:24:59.658574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d4f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=482000000,duration_sec=789,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:24:59.659165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:24:59.659527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:388 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:25:00.748556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5ff36942-3ef2-42f0-b5d4-83a17809b6a5 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:25:00Z,data_plane_status=None,description='',device_id='710d8936-179a-412b-9f1d-148e6648cebe',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4e861415-84ce-4923-aa54-770c8249a620,mac_address=fa:16:3e:23:2d:3e,name='',network_id=a72f6105-d258-45cb-a84d-18590bef93c2,numa_affinity_policy=,project_id='1c6cc70cbd2b4c04864f33ebafa06b5a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4e861415-84ce-4923-aa54-770c8249a620),security_group_ids=set([54bc43f8-7528-41d7-83a2-7be375d773a9]),status='DOWN',updated_at=2022-09-27T04:25:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:25:00.749231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5ff36942-3ef2-42f0-b5d4-83a17809b6a5 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (4e861415-84ce-4923-aa54-770c8249a620), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:00.749452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5ff36942-3ef2-42f0-b5d4-83a17809b6a5 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group member updated {'54bc43f8-7528-41d7-83a2-7be375d773a9'} Sep 27 04:25:01.251186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-111fd070-4454-430e-859f-01afb6b959b1 service neutron] Resource Port 4e861415-84ce-4923-aa54-770c8249a620 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=4e861415-84ce-4923-aa54-770c8249a620,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=4e861415-84ce-4923-aa54-770c8249a620,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:01.251742 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-111fd070-4454-430e-859f-01afb6b959b1 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (4e861415-84ce-4923-aa54-770c8249a620), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:01.574039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-111fd070-4454-430e-859f-01afb6b959b1 service neutron] Resource Port 4e861415-84ce-4923-aa54-770c8249a620 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=4e861415-84ce-4923-aa54-770c8249a620,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=4e861415-84ce-4923-aa54-770c8249a620,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=4e861415-84ce-4923-aa54-770c8249a620,segment=NetworkSegment(a913cdfa-72ec-4cc3-8b5c-57a3fb6a0921),segment_id=a913cdfa-72ec-4cc3-8b5c-57a3fb6a0921)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:01.574614 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-111fd070-4454-430e-859f-01afb6b959b1 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (4e861415-84ce-4923-aa54-770c8249a620), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:01.655885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:389 started Sep 27 04:25:01.658989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=483000000,duration_sec=791,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:01.659586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:01.660024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:389 - starting polling. Elapsed:0.004 Sep 27 04:25:01.663129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:01.666613 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:389 - port information retrieved. Elapsed:0.011 Sep 27 04:25:01.666951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:389 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:25:03.656942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:390 started Sep 27 04:25:03.660208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d53,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=484000000,duration_sec=793,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:03.661127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:03.661519 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:390 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:25:04.983281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 4e861415-84ce-4923-aa54-770c8249a620 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:04.983889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (4e861415-84ce-4923-aa54-770c8249a620), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:05.658205 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:391 started Sep 27 04:25:05.660467 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d55,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=485000000,duration_sec=795,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:05.661312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:05.661651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:391 - starting polling. Elapsed:0.004 Sep 27 04:25:05.664695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:05.668081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:391 - port information retrieved. Elapsed:0.010 Sep 27 04:25:05.668416 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:391 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:25:07.005688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 4e861415-84ce-4923-aa54-770c8249a620 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:07.006352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (4e861415-84ce-4923-aa54-770c8249a620), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:07.658955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:392 started Sep 27 04:25:07.661673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d57,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=486000000,duration_sec=797,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:07.662277 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:07.663244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:392 - starting polling. Elapsed:0.004 Sep 27 04:25:07.665403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:07.668924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:392 - port information retrieved. Elapsed:0.010 Sep 27 04:25:07.669271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:392 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:25:09.660589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:393 started Sep 27 04:25:09.665712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d59,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=488000000,duration_sec=799,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:09.666546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:09.667113 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:393 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 27 04:25:10.484626 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fe1da22b-89c5-439b-b524-bec26756fcf5 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:25:10Z,data_plane_status=None,description='',device_id='3063ca42-9212-4df2-af49-0d7d4a88c0ee',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=eb918bb7-1383-468a-8553-7476aae953bb,mac_address=fa:16:3e:2d:d5:98,name='',network_id=41cd98f9-b206-4445-9870-d24633bca602,numa_affinity_policy=,project_id='1e595829629a4dd4a7fccbdabc896cb0',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(eb918bb7-1383-468a-8553-7476aae953bb),security_group_ids=set([ed46206f-12d5-4819-aa08-0f95f9ac185f]),status='DOWN',updated_at=2022-09-27T04:25:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:25:10.485446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fe1da22b-89c5-439b-b524-bec26756fcf5 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (eb918bb7-1383-468a-8553-7476aae953bb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:10.486155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fe1da22b-89c5-439b-b524-bec26756fcf5 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group member updated {'ed46206f-12d5-4819-aa08-0f95f9ac185f'} Sep 27 04:25:11.191846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-95f51519-6ef4-4d4d-a982-0c509a456d3b service neutron] Resource Port eb918bb7-1383-468a-8553-7476aae953bb updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=eb918bb7-1383-468a-8553-7476aae953bb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=eb918bb7-1383-468a-8553-7476aae953bb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:11.192975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-95f51519-6ef4-4d4d-a982-0c509a456d3b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (eb918bb7-1383-468a-8553-7476aae953bb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:11.576178 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-95f51519-6ef4-4d4d-a982-0c509a456d3b service neutron] Resource Port eb918bb7-1383-468a-8553-7476aae953bb updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=eb918bb7-1383-468a-8553-7476aae953bb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=eb918bb7-1383-468a-8553-7476aae953bb,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=eb918bb7-1383-468a-8553-7476aae953bb,segment=NetworkSegment(26969db0-2998-4ace-a23e-359a5b524a75),segment_id=26969db0-2998-4ace-a23e-359a5b524a75)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:11.576647 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-95f51519-6ef4-4d4d-a982-0c509a456d3b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (eb918bb7-1383-468a-8553-7476aae953bb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:11.662233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:394 started Sep 27 04:25:11.667856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=489000000,duration_sec=801,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:11.669395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:11.669995 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:394 - starting polling. Elapsed:0.008 Sep 27 04:25:11.675654 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:11.679310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:394 - port information retrieved. Elapsed:0.017 Sep 27 04:25:11.680429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:394 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 27 04:25:13.663434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:395 started Sep 27 04:25:13.666283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d5d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=490000000,duration_sec=803,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:13.666851 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:13.667203 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:395 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:25:15.664584 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:396 started Sep 27 04:25:15.667070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=491000000,duration_sec=805,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:15.667648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:15.668026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:396 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:25:17.666070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:397 started Sep 27 04:25:17.668318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d61,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=493000000,duration_sec=807,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:17.668915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:17.669269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:397 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:25:19.666629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:398 started Sep 27 04:25:19.668841 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=493000000,duration_sec=809,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:19.669398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:19.669769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:398 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:25:21.062978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port eb918bb7-1383-468a-8553-7476aae953bb updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:21.063578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (eb918bb7-1383-468a-8553-7476aae953bb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:21.667329 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:399 started Sep 27 04:25:21.669813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d65,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=494000000,duration_sec=811,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:21.670373 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:21.670738 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:399 - starting polling. Elapsed:0.004 Sep 27 04:25:21.673260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:21.676653 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:399 - port information retrieved. Elapsed:0.010 Sep 27 04:25:21.676989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:399 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:25:23.065735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port eb918bb7-1383-468a-8553-7476aae953bb updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:23.066472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (eb918bb7-1383-468a-8553-7476aae953bb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:23.667831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:400 started Sep 27 04:25:23.670379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=494000000,duration_sec=813,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:23.671049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:23.671455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:400 - starting polling. Elapsed:0.004 Sep 27 04:25:23.674080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:23.677529 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:400 - port information retrieved. Elapsed:0.010 Sep 27 04:25:23.677893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:400 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:25:25.668415 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:401 started Sep 27 04:25:25.670999 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d69,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=495000000,duration_sec=815,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:25.671562 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:25.671941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:401 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:25:26.915027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7b425b3c-f0b6-4236-8484-244591197394 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:25:26Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=05230db1-5556-4943-8805-ed0952617e69,mac_address=fa:16:3e:62:a0:10,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(05230db1-5556-4943-8805-ed0952617e69),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:25:26Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:25:26.915665 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7b425b3c-f0b6-4236-8484-244591197394 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (05230db1-5556-4943-8805-ed0952617e69), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:27.669362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:402 started Sep 27 04:25:27.671879 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d6b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=496000000,duration_sec=817,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:27.672461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:27.672789 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:402 - starting polling. Elapsed:0.004 Sep 27 04:25:27.675561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:27.679556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:402 - port information retrieved. Elapsed:0.010 Sep 27 04:25:27.680618 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:402 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:25:27.764380 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7b425b3c-f0b6-4236-8484-244591197394 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource Port 05230db1-5556-4943-8805-ed0952617e69 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '24c2e778-3a7e-45af-b09b-e35f074bdf0a'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:27.764764 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7b425b3c-f0b6-4236-8484-244591197394 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (05230db1-5556-4943-8805-ed0952617e69), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:29.670766 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:403 started Sep 27 04:25:29.673095 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d6d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=497000000,duration_sec=819,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:29.673667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:29.674076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:403 - starting polling. Elapsed:0.003 Sep 27 04:25:29.676631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:29.680073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:403 - port information retrieved. Elapsed:0.010 Sep 27 04:25:29.680409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:403 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:25:31.671446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:404 started Sep 27 04:25:31.674068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=498000000,duration_sec=821,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:31.674647 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:31.675005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:404 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:25:33.672404 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:405 started Sep 27 04:25:33.674678 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d71,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=499000000,duration_sec=823,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:33.675249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:33.675604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:405 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:25:35.673414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:406 started Sep 27 04:25:35.675782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d73,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=500000000,duration_sec=825,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:35.676370 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:35.676746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:406 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:25:37.674729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:407 started Sep 27 04:25:37.677505 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=501000000,duration_sec=827,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:37.678115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:37.678473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:407 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:25:39.675332 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:408 started Sep 27 04:25:39.677626 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=502000000,duration_sec=829,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:39.678223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:39.678576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:408 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:25:41.676315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:409 started Sep 27 04:25:41.679138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=503000000,duration_sec=831,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:41.679709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:41.680088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:409 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:25:42.861961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d2d03440-380f-47df-be65-155372e965f3 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Resource Port deleted: 8760ae9b-e8ce-45d6-a54c-90337fdcb044 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:25:42.863297 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d2d03440-380f-47df-be65-155372e965f3 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (8760ae9b-e8ce-45d6-a54c-90337fdcb044), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:42.863778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d2d03440-380f-47df-be65-155372e965f3 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group member updated {'8941aa61-f42a-42af-9d20-9d356758a62d'} Sep 27 04:25:43.676872 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:410 started Sep 27 04:25:43.679435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=504000000,duration_sec=833,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:43.680081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:43.681019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:410 - starting polling. Elapsed:0.004 Sep 27 04:25:43.683655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:43.685465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 8760ae9b-e8ce-45d6-a54c-90337fdcb044 not present in bridge br-int Sep 27 04:25:43.685838 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:25:43.686193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['8760ae9b-e8ce-45d6-a54c-90337fdcb044'] Sep 27 04:25:43.686524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 8760ae9b-e8ce-45d6-a54c-90337fdcb044 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:25:43.689924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:410 - port information retrieved. Elapsed:0.013 Sep 27 04:25:43.690262 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:410 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 27 04:25:44.576620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Resource SecurityGroup deleted: 8941aa61-f42a-42af-9d20-9d356758a62d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:25:44.577237 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (8941aa61-f42a-42af-9d20-9d356758a62d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:44.577482 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8941aa61-f42a-42af-9d20-9d356758a62d',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:25:44.591020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8941aa61-f42a-42af-9d20-9d356758a62d',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:25:44.591539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Resource SecurityGroupRule deleted: 354954d4-b4a6-499a-b24b-530e8617dfba {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:25:44.591937 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (354954d4-b4a6-499a-b24b-530e8617dfba), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:44.592288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group rule updated ['8941aa61-f42a-42af-9d20-9d356758a62d'] Sep 27 04:25:44.592719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Resource SecurityGroupRule deleted: 7861d88a-9f15-4c71-865e-48edfb1f5b4a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:25:44.593073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7861d88a-9f15-4c71-865e-48edfb1f5b4a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:44.593396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group rule updated ['8941aa61-f42a-42af-9d20-9d356758a62d'] Sep 27 04:25:44.593957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Resource SecurityGroupRule deleted: cac2b0ac-07c2-43e4-ad95-c52d0599d12a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:25:44.594307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cac2b0ac-07c2-43e4-ad95-c52d0599d12a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:44.594630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group rule updated ['8941aa61-f42a-42af-9d20-9d356758a62d'] Sep 27 04:25:44.595032 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Resource SecurityGroupRule deleted: ca202269-191e-43de-91df-9534bc15da3b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:25:44.595378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ca202269-191e-43de-91df-9534bc15da3b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:44.595698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cebbb3a5-4c9f-4544-b69f-fef9ef743f4b tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group rule updated ['8941aa61-f42a-42af-9d20-9d356758a62d'] Sep 27 04:25:44.954810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-67eaeadc-64b5-44f6-b79d-ff52ff26219c tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Resource Port deleted: eb0cee21-53cc-4a6b-aa49-0a081413dc60 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:25:44.955217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-67eaeadc-64b5-44f6-b79d-ff52ff26219c tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (eb0cee21-53cc-4a6b-aa49-0a081413dc60), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:45.237573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b5c073b9-7000-4407-b92c-8e4279bf0f72 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:45.237984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:45.677898 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:411 started Sep 27 04:25:45.680369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d7d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=504000000,duration_sec=835,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:45.681058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:45.681397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:411 - starting polling. Elapsed:0.004 Sep 27 04:25:45.684078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:45.685957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port eb0cee21-53cc-4a6b-aa49-0a081413dc60 not present in bridge br-int Sep 27 04:25:45.686295 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:25:45.686582 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['eb0cee21-53cc-4a6b-aa49-0a081413dc60'] Sep 27 04:25:45.686956 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port eb0cee21-53cc-4a6b-aa49-0a081413dc60 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:25:45.690271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:411 - port information retrieved. Elapsed:0.013 Sep 27 04:25:45.690607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:411 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 27 04:25:47.307608 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b5c073b9-7000-4407-b92c-8e4279bf0f72 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:47.308176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:47.679312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:412 started Sep 27 04:25:47.682581 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d7f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=506000000,duration_sec=837,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:47.683398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:47.683791 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:412 - starting polling. Elapsed:0.005 Sep 27 04:25:47.686657 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:47.690146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:412 - port information retrieved. Elapsed:0.011 Sep 27 04:25:47.690644 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:412 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:25:49.680083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:413 started Sep 27 04:25:49.683778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d81,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=508000000,duration_sec=839,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:49.684355 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:49.684714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:413 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:25:50.564244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ea4c2441-54b6-4271-be5d-f2613a7debfa tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Resource Port deleted: b0f3948b-c804-4958-9c96-5fefbd31faea {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:25:50.567160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ea4c2441-54b6-4271-be5d-f2613a7debfa tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (b0f3948b-c804-4958-9c96-5fefbd31faea), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:50.567867 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ea4c2441-54b6-4271-be5d-f2613a7debfa tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group member updated {'dad0251b-74f4-4f16-a784-be5aec073ee7'} Sep 27 04:25:51.682548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:414 started Sep 27 04:25:51.685819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d83,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=509000000,duration_sec=841,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:51.686971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:51.687602 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:414 - starting polling. Elapsed:0.006 Sep 27 04:25:51.691004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:51.692909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b0f3948b-c804-4958-9c96-5fefbd31faea not present in bridge br-int Sep 27 04:25:51.693257 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:25:51.693551 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['b0f3948b-c804-4958-9c96-5fefbd31faea'] Sep 27 04:25:51.693906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b0f3948b-c804-4958-9c96-5fefbd31faea is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:25:51.698757 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:414 - port information retrieved. Elapsed:0.017 Sep 27 04:25:51.699436 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:414 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 27 04:25:53.684174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:415 started Sep 27 04:25:53.688175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d85,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=512000000,duration_sec=843,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:53.689155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:53.689708 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:415 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 27 04:25:55.684330 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:416 started Sep 27 04:25:55.688022 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d87,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=512000000,duration_sec=845,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:55.688778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:55.689322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:416 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:25:57.035023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4273ac1d-e9bd-493a-abd1-37cbca60e331 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Resource Port deleted: b602518b-6faa-4bc5-b2ba-22e555f27363 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:25:57.035543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4273ac1d-e9bd-493a-abd1-37cbca60e331 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (b602518b-6faa-4bc5-b2ba-22e555f27363), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:57.035821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4273ac1d-e9bd-493a-abd1-37cbca60e331 tempest-ServerRescueNegativeTestJSON-1742348020 tempest-ServerRescueNegativeTestJSON-1742348020-project] Security group member updated {'dad0251b-74f4-4f16-a784-be5aec073ee7'} Sep 27 04:25:57.685186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:417 started Sep 27 04:25:57.687904 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d89,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=512000000,duration_sec=847,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:57.688486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:57.688827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:417 - starting polling. Elapsed:0.004 Sep 27 04:25:57.691374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:57.693109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b602518b-6faa-4bc5-b2ba-22e555f27363 not present in bridge br-int Sep 27 04:25:57.693467 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:25:57.693777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['b602518b-6faa-4bc5-b2ba-22e555f27363'] Sep 27 04:25:57.694107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b602518b-6faa-4bc5-b2ba-22e555f27363 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:25:57.697446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:417 - port information retrieved. Elapsed:0.012 Sep 27 04:25:57.697813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:417 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 27 04:25:59.270087 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b5c073b9-7000-4407-b92c-8e4279bf0f72 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:25:59.270971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:59.686166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:418 started Sep 27 04:25:59.699196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d8b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=513000000,duration_sec=849,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:25:59.699792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:25:59.700134 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:418 - starting polling. Elapsed:0.014 Sep 27 04:25:59.703374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:25:59.706784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:418 - port information retrieved. Elapsed:0.021 Sep 27 04:25:59.707122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:418 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Sep 27 04:26:00.710829 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-80d38aa3-3fd6-4a63-a9e8-68b40a8f3757 admin admin] Resource Port deleted: 1cb6df63-5dd5-460b-86da-ef0071c67709 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:00.712356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-80d38aa3-3fd6-4a63-a9e8-68b40a8f3757 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (1cb6df63-5dd5-460b-86da-ef0071c67709), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:01.686765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:419 started Sep 27 04:26:01.689789 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d8d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=514000000,duration_sec=851,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:01.690649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:01.691000 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:419 - starting polling. Elapsed:0.004 Sep 27 04:26:01.693567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:01.697886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1cb6df63-5d, col_values=(('tag', 4095),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:26:01.721945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d8f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:01.724981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['1cb6df63-5dd5-460b-86da-ef0071c67709'] Sep 27 04:26:01.725659 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:26:01.788455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e098d8a9-e395-4c57-95f5-1da3fabfe94d]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:26:01.793028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:419 - port information retrieved. Elapsed:0.106 Sep 27 04:26:01.793376 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:419 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.107 Sep 27 04:26:01.854941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a209cd58-a0d6-497a-9eb9-b0fb9680afa3","delete","qr-1cb6df63-5d",16,["map",[["attached-mac","fa:16:3e:88:33:c3"],["iface-id","1cb6df63-5dd5-460b-86da-ef0071c67709"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:26:01.901972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1ba340ec-65b4-4d2c-9980-1fc5abc32bc4 admin admin] Resource Port deleted: b4d8a087-7ecc-4c15-a09e-d89340dc105d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:01.902362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1ba340ec-65b4-4d2c-9980-1fc5abc32bc4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (b4d8a087-7ecc-4c15-a09e-d89340dc105d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:02.257206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e2e4160b-93b4-4695-a6e4-bd56febc524d","delete","qg-b4d8a087-7e",17,["map",[["attached-mac","fa:16:3e:da:63:e0"],["iface-id","b4d8a087-7ecc-4c15-a09e-d89340dc105d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:26:02.386199 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c9585898-5596-4ffd-8462-2a64a550158b admin admin] Resource Subnet deleted: 3d4a66ea-0873-4a30-ab4a-55cd0b629103 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:02.386845 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c9585898-5596-4ffd-8462-2a64a550158b admin admin] Publish callbacks [] for Subnet (3d4a66ea-0873-4a30-ab4a-55cd0b629103), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:02.513857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ae66b86b-c623-4796-8585-ea223edcf876","delete","tap3a195ca1-f9",15,["map",[["attached-mac","fa:16:3e:d9:ea:ef"],["iface-id","3a195ca1-f95a-4b00-b874-500af40a79fd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:26:02.751386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3056b916-e8ec-4804-9adf-868f10411e50 admin admin] Resource Port deleted: 3a195ca1-f95a-4b00-b874-500af40a79fd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:02.752010 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3056b916-e8ec-4804-9adf-868f10411e50 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (3a195ca1-f95a-4b00-b874-500af40a79fd), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:02.894834 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8ee1fdc8-dc33-49f1-9aec-df46d29ea659 None None] Resource Port deleted: 3a195ca1-f95a-4b00-b874-500af40a79fd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:02.895294 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8ee1fdc8-dc33-49f1-9aec-df46d29ea659 None None] Skipped duplicate delete event for 3a195ca1-f95a-4b00-b874-500af40a79fd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 27 04:26:03.076659 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3056b916-e8ec-4804-9adf-868f10411e50 admin admin] Resource Network deleted: 3b03541e-a362-4f1f-858b-b7051275090d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:03.077433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3056b916-e8ec-4804-9adf-868f10411e50 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (3b03541e-a362-4f1f-858b-b7051275090d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:03.641951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Resource SecurityGroup deleted: dad0251b-74f4-4f16-a784-be5aec073ee7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:03.642382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (dad0251b-74f4-4f16-a784-be5aec073ee7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:03.642862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dad0251b-74f4-4f16-a784-be5aec073ee7',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:03.660053 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dad0251b-74f4-4f16-a784-be5aec073ee7',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:03.661009 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Resource SecurityGroupRule deleted: 5cee919a-b45e-423e-b3b7-a2e3c93ea526 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:03.661547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5cee919a-b45e-423e-b3b7-a2e3c93ea526), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:03.662218 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Security group rule updated ['dad0251b-74f4-4f16-a784-be5aec073ee7'] Sep 27 04:26:03.663056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Resource SecurityGroupRule deleted: 962bb38e-efcb-4e6f-bba3-006532dc756d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:03.663416 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (962bb38e-efcb-4e6f-bba3-006532dc756d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:03.663748 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Security group rule updated ['dad0251b-74f4-4f16-a784-be5aec073ee7'] Sep 27 04:26:03.664131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Resource SecurityGroupRule deleted: cdf0ab2f-dc59-4af1-b644-8019f66741be {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:03.664481 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cdf0ab2f-dc59-4af1-b644-8019f66741be), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:03.665352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Security group rule updated ['dad0251b-74f4-4f16-a784-be5aec073ee7'] Sep 27 04:26:03.665921 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Resource SecurityGroupRule deleted: fd1609e1-09fb-4396-9c49-f474c7725a44 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:03.666414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (fd1609e1-09fb-4396-9c49-f474c7725a44), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:03.666749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5f4b8346-082d-4028-b8f7-3174768feb8f admin admin] Security group rule updated ['dad0251b-74f4-4f16-a784-be5aec073ee7'] Sep 27 04:26:03.687756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:420 started Sep 27 04:26:03.693714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d91,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=516000000,duration_sec=853,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:03.694417 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:03.695483 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:420 - starting polling. Elapsed:0.007 Sep 27 04:26:03.699908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:03.708836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d93,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:03.713634 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d95,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:03.716540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22d97,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:03.717090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:420 - port information retrieved. Elapsed:0.030 Sep 27 04:26:03.718465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', '133717b2-0788-457d-9fba-bcfb1664cf21', 'b46b0326-166d-45b8-8db2-cac369fbf847', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '3644c780-ef74-4954-a68a-6cc2eadf34ce', '72256acd-5a77-4ad3-be5d-043dcec0575b', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': {'3a195ca1-f95a-4b00-b874-500af40a79fd', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:26:03.719775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:420 - agent port security group processed in 0.000 Sep 27 04:26:03.725206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:26:03.725540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'3a195ca1-f95a-4b00-b874-500af40a79fd', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d'} Sep 27 04:26:03.726963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 1cb6df63-5dd5-460b-86da-ef0071c67709 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:26:03.728168 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 8 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:26:03.813288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[97031557-dcd2-40c8-9198-5713253f2ced]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:26:03.814041 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'3a195ca1-f95a-4b00-b874-500af40a79fd', '1cb6df63-5dd5-460b-86da-ef0071c67709', 'b4d8a087-7ecc-4c15-a09e-d89340dc105d'} removed Sep 27 04:26:03.911594 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:26:03.912273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 7 from net-id = 3b03541e-a362-4f1f-858b-b7051275090d, seg-id = 132 Sep 27 04:26:03.916138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32eb7,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:03.919222 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc22d99,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4228}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:03.919572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:26:03.919956 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:420 - treat_devices_removed completed in 0.194 Sep 27 04:26:03.920250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:420 - ports processed. Elapsed:0.233 Sep 27 04:26:03.920578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:420 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.233 Sep 27 04:26:05.688768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:421 started Sep 27 04:26:05.691641 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d9b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=515000000,duration_sec=855,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:05.692235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:05.692755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:421 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:07.689612 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:422 started Sep 27 04:26:07.692092 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d9d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=516000000,duration_sec=857,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:07.692694 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:07.693037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:422 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:09.690336 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:423 started Sep 27 04:26:09.692948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22d9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=517000000,duration_sec=859,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:09.693524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:09.693988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:423 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:11.691414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:424 started Sep 27 04:26:11.694212 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22da1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=518000000,duration_sec=861,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:11.694784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:11.695141 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:424 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:13.683003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:13Z,description='Default security group',id=3dbe2a3a-1bd4-4ac9-8345-255b0ea71955,is_default=True,name='default',project_id='e2356c8895ab41f68983fc8328fad8cc',revision_number=1,rules=[SecurityGroupRule(2d5be070-cf13-43e5-b53c-568df00f7fb8),SecurityGroupRule(3287ade3-1327-4051-a6b7-c6100bd25791),SecurityGroupRule(5816fe5f-fb11-43e0-a92a-930deb034a49),SecurityGroupRule(b9e2cc62-42b4-4120-84e8-91cdf7d2dfa3)],shared=False,stateful=True,updated_at=2022-09-27T04:26:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:13.683643 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (3dbe2a3a-1bd4-4ac9-8345-255b0ea71955), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:13.684011 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:13Z,description=,direction='ingress',ethertype='IPv6',id=2d5be070-cf13-43e5-b53c-568df00f7fb8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e2356c8895ab41f68983fc8328fad8cc',protocol=,remote_address_group_id=,remote_group_id=3dbe2a3a-1bd4-4ac9-8345-255b0ea71955,remote_ip_prefix=,revision_number=0,security_group_id=3dbe2a3a-1bd4-4ac9-8345-255b0ea71955,updated_at=2022-09-27T04:26:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:13.684368 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2d5be070-cf13-43e5-b53c-568df00f7fb8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:13.684699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Security group rule updated ['3dbe2a3a-1bd4-4ac9-8345-255b0ea71955'] Sep 27 04:26:13.685386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:13Z,description=,direction='egress',ethertype='IPv6',id=3287ade3-1327-4051-a6b7-c6100bd25791,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e2356c8895ab41f68983fc8328fad8cc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3dbe2a3a-1bd4-4ac9-8345-255b0ea71955,updated_at=2022-09-27T04:26:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:13.685780 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3287ade3-1327-4051-a6b7-c6100bd25791), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:13.686105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Security group rule updated ['3dbe2a3a-1bd4-4ac9-8345-255b0ea71955'] Sep 27 04:26:13.686762 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:13Z,description=,direction='egress',ethertype='IPv4',id=5816fe5f-fb11-43e0-a92a-930deb034a49,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e2356c8895ab41f68983fc8328fad8cc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3dbe2a3a-1bd4-4ac9-8345-255b0ea71955,updated_at=2022-09-27T04:26:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:13.687108 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5816fe5f-fb11-43e0-a92a-930deb034a49), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:13.687430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Security group rule updated ['3dbe2a3a-1bd4-4ac9-8345-255b0ea71955'] Sep 27 04:26:13.688067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:13Z,description=,direction='ingress',ethertype='IPv4',id=b9e2cc62-42b4-4120-84e8-91cdf7d2dfa3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e2356c8895ab41f68983fc8328fad8cc',protocol=,remote_address_group_id=,remote_group_id=3dbe2a3a-1bd4-4ac9-8345-255b0ea71955,remote_ip_prefix=,revision_number=0,security_group_id=3dbe2a3a-1bd4-4ac9-8345-255b0ea71955,updated_at=2022-09-27T04:26:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:13.688410 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b9e2cc62-42b4-4120-84e8-91cdf7d2dfa3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:13.688728 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0041c9a2-d1b3-4079-860e-2d9e1b8c3e60 admin admin] Security group rule updated ['3dbe2a3a-1bd4-4ac9-8345-255b0ea71955'] Sep 27 04:26:13.692015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:425 started Sep 27 04:26:13.694468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22da3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=519000000,duration_sec=863,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:13.695035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:13.695384 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:425 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:26:13.808233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Resource SecurityGroup deleted: 3dbe2a3a-1bd4-4ac9-8345-255b0ea71955 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:13.808614 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (3dbe2a3a-1bd4-4ac9-8345-255b0ea71955), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:13.809070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3dbe2a3a-1bd4-4ac9-8345-255b0ea71955',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:13.823236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3dbe2a3a-1bd4-4ac9-8345-255b0ea71955',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:13.823855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Resource SecurityGroupRule deleted: 2d5be070-cf13-43e5-b53c-568df00f7fb8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:13.824220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2d5be070-cf13-43e5-b53c-568df00f7fb8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:13.824554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Security group rule updated ['3dbe2a3a-1bd4-4ac9-8345-255b0ea71955'] Sep 27 04:26:13.824944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Resource SecurityGroupRule deleted: 3287ade3-1327-4051-a6b7-c6100bd25791 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:13.825288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3287ade3-1327-4051-a6b7-c6100bd25791), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:13.825657 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Security group rule updated ['3dbe2a3a-1bd4-4ac9-8345-255b0ea71955'] Sep 27 04:26:13.826063 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Resource SecurityGroupRule deleted: 5816fe5f-fb11-43e0-a92a-930deb034a49 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:13.826404 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5816fe5f-fb11-43e0-a92a-930deb034a49), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:13.826719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Security group rule updated ['3dbe2a3a-1bd4-4ac9-8345-255b0ea71955'] Sep 27 04:26:13.827088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Resource SecurityGroupRule deleted: b9e2cc62-42b4-4120-84e8-91cdf7d2dfa3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:13.827425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b9e2cc62-42b4-4120-84e8-91cdf7d2dfa3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:13.827738 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-11e60dfe-fecc-4a89-a3ed-447161e040b3 admin admin] Security group rule updated ['3dbe2a3a-1bd4-4ac9-8345-255b0ea71955'] Sep 27 04:26:15.294001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:15Z,description='Default security group',id=d0c9b44e-b202-42e0-aa83-e6f60d66af02,is_default=True,name='default',project_id='49ef5f872e954a9295f1d2e1a00632b8',revision_number=1,rules=[SecurityGroupRule(17fa8901-2516-4b77-9492-4a157b297315),SecurityGroupRule(54025377-6277-404b-b85a-c4b66d994256),SecurityGroupRule(ac597a94-5e99-46a2-8fc3-dc86989cfc4d),SecurityGroupRule(ed1cd01a-2f44-42bf-bcee-0b57087b79a6)],shared=False,stateful=True,updated_at=2022-09-27T04:26:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:15.295445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (d0c9b44e-b202-42e0-aa83-e6f60d66af02), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.297059 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:15Z,description=,direction='ingress',ethertype='IPv6',id=17fa8901-2516-4b77-9492-4a157b297315,normalized_cidr=None,port_range_max=,port_range_min=,project_id='49ef5f872e954a9295f1d2e1a00632b8',protocol=,remote_address_group_id=,remote_group_id=d0c9b44e-b202-42e0-aa83-e6f60d66af02,remote_ip_prefix=,revision_number=0,security_group_id=d0c9b44e-b202-42e0-aa83-e6f60d66af02,updated_at=2022-09-27T04:26:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:15.297842 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (17fa8901-2516-4b77-9492-4a157b297315), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.298395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Security group rule updated ['d0c9b44e-b202-42e0-aa83-e6f60d66af02'] Sep 27 04:26:15.299910 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:15Z,description=,direction='egress',ethertype='IPv4',id=54025377-6277-404b-b85a-c4b66d994256,normalized_cidr=None,port_range_max=,port_range_min=,project_id='49ef5f872e954a9295f1d2e1a00632b8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d0c9b44e-b202-42e0-aa83-e6f60d66af02,updated_at=2022-09-27T04:26:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:15.300978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (54025377-6277-404b-b85a-c4b66d994256), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.301556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Security group rule updated ['d0c9b44e-b202-42e0-aa83-e6f60d66af02'] Sep 27 04:26:15.302873 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:15Z,description=,direction='ingress',ethertype='IPv4',id=ac597a94-5e99-46a2-8fc3-dc86989cfc4d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='49ef5f872e954a9295f1d2e1a00632b8',protocol=,remote_address_group_id=,remote_group_id=d0c9b44e-b202-42e0-aa83-e6f60d66af02,remote_ip_prefix=,revision_number=0,security_group_id=d0c9b44e-b202-42e0-aa83-e6f60d66af02,updated_at=2022-09-27T04:26:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:15.304340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ac597a94-5e99-46a2-8fc3-dc86989cfc4d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.305385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Security group rule updated ['d0c9b44e-b202-42e0-aa83-e6f60d66af02'] Sep 27 04:26:15.308309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:15Z,description=,direction='egress',ethertype='IPv6',id=ed1cd01a-2f44-42bf-bcee-0b57087b79a6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='49ef5f872e954a9295f1d2e1a00632b8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d0c9b44e-b202-42e0-aa83-e6f60d66af02,updated_at=2022-09-27T04:26:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:15.309076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ed1cd01a-2f44-42bf-bcee-0b57087b79a6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.309662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-dd1b4692-32fb-4b39-be59-0ca3cee6482f admin admin] Security group rule updated ['d0c9b44e-b202-42e0-aa83-e6f60d66af02'] Sep 27 04:26:15.437343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b5c073b9-7000-4407-b92c-8e4279bf0f72 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:26:15.438030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.465318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Resource SecurityGroup deleted: d0c9b44e-b202-42e0-aa83-e6f60d66af02 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:15.466005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (d0c9b44e-b202-42e0-aa83-e6f60d66af02), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.466979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d0c9b44e-b202-42e0-aa83-e6f60d66af02',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:15.481603 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d0c9b44e-b202-42e0-aa83-e6f60d66af02',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:15.482114 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Resource SecurityGroupRule deleted: 17fa8901-2516-4b77-9492-4a157b297315 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:15.482489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (17fa8901-2516-4b77-9492-4a157b297315), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.482827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Security group rule updated ['d0c9b44e-b202-42e0-aa83-e6f60d66af02'] Sep 27 04:26:15.483367 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Resource SecurityGroupRule deleted: 54025377-6277-404b-b85a-c4b66d994256 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:15.484137 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (54025377-6277-404b-b85a-c4b66d994256), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.484631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Security group rule updated ['d0c9b44e-b202-42e0-aa83-e6f60d66af02'] Sep 27 04:26:15.485185 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Resource SecurityGroupRule deleted: ac597a94-5e99-46a2-8fc3-dc86989cfc4d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:15.485537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ac597a94-5e99-46a2-8fc3-dc86989cfc4d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.485882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Security group rule updated ['d0c9b44e-b202-42e0-aa83-e6f60d66af02'] Sep 27 04:26:15.486255 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Resource SecurityGroupRule deleted: ed1cd01a-2f44-42bf-bcee-0b57087b79a6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:15.486632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ed1cd01a-2f44-42bf-bcee-0b57087b79a6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.486954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7e2ae65b-53ad-45e6-be7b-b9453b0f6e46 admin admin] Security group rule updated ['d0c9b44e-b202-42e0-aa83-e6f60d66af02'] Sep 27 04:26:15.694008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:426 started Sep 27 04:26:15.700490 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22da5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=522000000,duration_sec=865,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:15.707317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:15.708141 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:426 - starting polling. Elapsed:0.014 Sep 27 04:26:15.713906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:15.727737 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:426 - port information retrieved. Elapsed:0.033 Sep 27 04:26:15.728371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:426 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.034 Sep 27 04:26:16.429576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:16Z,description='Default security group',id=91751976-ab00-4687-a70a-b84748ab375c,is_default=True,name='default',project_id='4a3fd16699244bbd88bd49792d3972c1',revision_number=1,rules=[SecurityGroupRule(0ea23e92-64bd-4ed1-b015-b621e9220ff8),SecurityGroupRule(c00e5f46-5ce9-4845-b433-3848daf9ffd2),SecurityGroupRule(cdcf8388-9c85-4000-93ba-ec11b2aa3214),SecurityGroupRule(fdaf583f-8f2a-4d91-a3f0-3b004395b523)],shared=False,stateful=True,updated_at=2022-09-27T04:26:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:16.430216 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (91751976-ab00-4687-a70a-b84748ab375c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:16.430653 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:16Z,description=,direction='egress',ethertype='IPv4',id=0ea23e92-64bd-4ed1-b015-b621e9220ff8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4a3fd16699244bbd88bd49792d3972c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=91751976-ab00-4687-a70a-b84748ab375c,updated_at=2022-09-27T04:26:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:16.431023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0ea23e92-64bd-4ed1-b015-b621e9220ff8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:16.431801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Security group rule updated ['91751976-ab00-4687-a70a-b84748ab375c'] Sep 27 04:26:16.432527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:16Z,description=,direction='ingress',ethertype='IPv4',id=c00e5f46-5ce9-4845-b433-3848daf9ffd2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4a3fd16699244bbd88bd49792d3972c1',protocol=,remote_address_group_id=,remote_group_id=91751976-ab00-4687-a70a-b84748ab375c,remote_ip_prefix=,revision_number=0,security_group_id=91751976-ab00-4687-a70a-b84748ab375c,updated_at=2022-09-27T04:26:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:16.432890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c00e5f46-5ce9-4845-b433-3848daf9ffd2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:16.433234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Security group rule updated ['91751976-ab00-4687-a70a-b84748ab375c'] Sep 27 04:26:16.433926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:16Z,description=,direction='ingress',ethertype='IPv6',id=cdcf8388-9c85-4000-93ba-ec11b2aa3214,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4a3fd16699244bbd88bd49792d3972c1',protocol=,remote_address_group_id=,remote_group_id=91751976-ab00-4687-a70a-b84748ab375c,remote_ip_prefix=,revision_number=0,security_group_id=91751976-ab00-4687-a70a-b84748ab375c,updated_at=2022-09-27T04:26:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:16.434290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cdcf8388-9c85-4000-93ba-ec11b2aa3214), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:16.434623 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Security group rule updated ['91751976-ab00-4687-a70a-b84748ab375c'] Sep 27 04:26:16.435317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:16Z,description=,direction='egress',ethertype='IPv6',id=fdaf583f-8f2a-4d91-a3f0-3b004395b523,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4a3fd16699244bbd88bd49792d3972c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=91751976-ab00-4687-a70a-b84748ab375c,updated_at=2022-09-27T04:26:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:16.435675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (fdaf583f-8f2a-4d91-a3f0-3b004395b523), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:16.436010 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Security group rule updated ['91751976-ab00-4687-a70a-b84748ab375c'] Sep 27 04:26:16.600812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:26:16Z,description='',dns_domain=None,id=0f17ed8e-4513-4443-ad29-4050fbff1f67,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-238242072-network',project_id='4a3fd16699244bbd88bd49792d3972c1',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(0f17ed8e-4513-4443-ad29-4050fbff1f67),segments=[NetworkSegment(e7bbe298-55b6-4ff4-aebe-216b23f51cf3)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:26:16Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:16.601511 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (0f17ed8e-4513-4443-ad29-4050fbff1f67), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-0f03f4f7-8b10-403c-9b2a-0dea42bf1479 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 0f17ed8e-4513-4443-ad29-4050fbff1f67 with segmentation id not found. Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:26:16.810534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:26:16.811684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:26:16.811684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:26:16.811684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:26:16.811684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 0f17ed8e-4513-4443-ad29-4050fbff1f67 with segmentation id not found. Sep 27 04:26:16.811684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:26:17.135665 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3c22852e-d5a2-4ef5-aa56-6723dcd23c40 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(84d64b4e-dfcd-4ccd-a4ac-01d0aa6a5078)],cidr=172.20.0.0/28,created_at=2022-09-27T04:26:16Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=ad30fcdd-012b-43ba-9c7b-113c530aa41b,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-238242072-subnet',network_id=0f17ed8e-4513-4443-ad29-4050fbff1f67,project_id='4a3fd16699244bbd88bd49792d3972c1',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:26:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:17.136132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3c22852e-d5a2-4ef5-aa56-6723dcd23c40 admin admin] Publish callbacks [] for Subnet (ad30fcdd-012b-43ba-9c7b-113c530aa41b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:17.616351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port b5c073b9-7000-4407-b92c-8e4279bf0f72 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:26:17.616926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:17.695385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:427 started Sep 27 04:26:17.699322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22da7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=523000000,duration_sec=867,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:17.700026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:17.700454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:427 - starting polling. Elapsed:0.005 Sep 27 04:26:17.702964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:17.706036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:427 - port information retrieved. Elapsed:0.011 Sep 27 04:26:17.706628 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:427 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:26:17.990733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:17Z,description='Default security group',id=08c9d646-a17c-45d8-957b-c87185925318,is_default=True,name='default',project_id='79e01f607d3545c9a76cd6ab096aeeac',revision_number=1,rules=[SecurityGroupRule(6314d114-11fc-4309-8982-9523411ee77a),SecurityGroupRule(ab02c082-c390-4369-83df-b826a556248f),SecurityGroupRule(b88b1382-dfac-48ba-bb44-202af7b63feb),SecurityGroupRule(f89005e7-1c74-413f-8778-618e6ebfc6ff)],shared=False,stateful=True,updated_at=2022-09-27T04:26:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:17.991317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (08c9d646-a17c-45d8-957b-c87185925318), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:17.992000 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:17Z,description=,direction='ingress',ethertype='IPv4',id=6314d114-11fc-4309-8982-9523411ee77a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='79e01f607d3545c9a76cd6ab096aeeac',protocol=,remote_address_group_id=,remote_group_id=08c9d646-a17c-45d8-957b-c87185925318,remote_ip_prefix=,revision_number=0,security_group_id=08c9d646-a17c-45d8-957b-c87185925318,updated_at=2022-09-27T04:26:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:17.992366 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6314d114-11fc-4309-8982-9523411ee77a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:17.992704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Security group rule updated ['08c9d646-a17c-45d8-957b-c87185925318'] Sep 27 04:26:17.993404 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:17Z,description=,direction='egress',ethertype='IPv6',id=ab02c082-c390-4369-83df-b826a556248f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='79e01f607d3545c9a76cd6ab096aeeac',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=08c9d646-a17c-45d8-957b-c87185925318,updated_at=2022-09-27T04:26:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:17.993784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ab02c082-c390-4369-83df-b826a556248f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:17.994765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Security group rule updated ['08c9d646-a17c-45d8-957b-c87185925318'] Sep 27 04:26:17.995436 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:17Z,description=,direction='ingress',ethertype='IPv6',id=b88b1382-dfac-48ba-bb44-202af7b63feb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='79e01f607d3545c9a76cd6ab096aeeac',protocol=,remote_address_group_id=,remote_group_id=08c9d646-a17c-45d8-957b-c87185925318,remote_ip_prefix=,revision_number=0,security_group_id=08c9d646-a17c-45d8-957b-c87185925318,updated_at=2022-09-27T04:26:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:17.995791 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b88b1382-dfac-48ba-bb44-202af7b63feb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:17.996125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Security group rule updated ['08c9d646-a17c-45d8-957b-c87185925318'] Sep 27 04:26:17.996779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:17Z,description=,direction='egress',ethertype='IPv4',id=f89005e7-1c74-413f-8778-618e6ebfc6ff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='79e01f607d3545c9a76cd6ab096aeeac',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=08c9d646-a17c-45d8-957b-c87185925318,updated_at=2022-09-27T04:26:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:17.997132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f89005e7-1c74-413f-8778-618e6ebfc6ff), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:17.997466 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Security group rule updated ['08c9d646-a17c-45d8-957b-c87185925318'] Sep 27 04:26:18.133867 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:26:17Z,description='',dns_domain=None,id=bb459e0a-e513-4b18-8757-c5f17626c9c0,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-929557175-network',project_id='79e01f607d3545c9a76cd6ab096aeeac',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(bb459e0a-e513-4b18-8757-c5f17626c9c0),segments=[NetworkSegment(1a01b7d2-156d-4aec-922b-b36f1add39e9)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:26:17Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:18.134334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (bb459e0a-e513-4b18-8757-c5f17626c9c0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-a835fbb9-9801-4df0-a64b-a84d9db4a397 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network bb459e0a-e513-4b18-8757-c5f17626c9c0 with segmentation id not found. Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:26:18.210244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:26:18.211339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:26:18.211339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:26:18.211339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:26:18.211339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network bb459e0a-e513-4b18-8757-c5f17626c9c0 with segmentation id not found. Sep 27 04:26:18.211339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:26:18.372792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c069ddd1-bb6a-4de8-bbd0-53a2e06621b1 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(26c81dcb-3f8b-4ea2-b5af-ae4662d38517)],cidr=172.20.0.0/28,created_at=2022-09-27T04:26:18Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=2628dac8-fe69-419b-b390-6952530cad50,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-929557175-subnet',network_id=bb459e0a-e513-4b18-8757-c5f17626c9c0,project_id='79e01f607d3545c9a76cd6ab096aeeac',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:26:18Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:18.373163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c069ddd1-bb6a-4de8-bbd0-53a2e06621b1 admin admin] Publish callbacks [] for Subnet (2628dac8-fe69-419b-b390-6952530cad50), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:18.765655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a546468b-5111-4891-b253-0a5ce01b2c32 admin admin] Resource Subnet deleted: ad30fcdd-012b-43ba-9c7b-113c530aa41b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:18.766300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a546468b-5111-4891-b253-0a5ce01b2c32 admin admin] Publish callbacks [] for Subnet (ad30fcdd-012b-43ba-9c7b-113c530aa41b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:19.093796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1a2cbb32-1576-4298-b8f3-2e592d62ee6b admin admin] Resource Network deleted: 0f17ed8e-4513-4443-ad29-4050fbff1f67 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:19.094266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1a2cbb32-1576-4298-b8f3-2e592d62ee6b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (0f17ed8e-4513-4443-ad29-4050fbff1f67), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:19.302095 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-006d0a65-fa79-4910-b085-9ae37fc5a10e admin admin] Resource Subnet deleted: 2628dac8-fe69-419b-b390-6952530cad50 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:19.302465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-006d0a65-fa79-4910-b085-9ae37fc5a10e admin admin] Publish callbacks [] for Subnet (2628dac8-fe69-419b-b390-6952530cad50), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:19.615920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f4a4393e-817b-46fa-b815-cc08375c7595 admin admin] Resource Network deleted: bb459e0a-e513-4b18-8757-c5f17626c9c0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:19.616301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f4a4393e-817b-46fa-b815-cc08375c7595 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (bb459e0a-e513-4b18-8757-c5f17626c9c0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:19.697048 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:428 started Sep 27 04:26:19.699989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22da9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=524000000,duration_sec=869,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:19.700565 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:19.700923 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:428 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:19.971407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Resource SecurityGroup deleted: 91751976-ab00-4687-a70a-b84748ab375c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:19.972473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (91751976-ab00-4687-a70a-b84748ab375c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:19.973148 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('91751976-ab00-4687-a70a-b84748ab375c',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:19.987919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('91751976-ab00-4687-a70a-b84748ab375c',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:19.988936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Resource SecurityGroupRule deleted: 0ea23e92-64bd-4ed1-b015-b621e9220ff8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:19.989331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0ea23e92-64bd-4ed1-b015-b621e9220ff8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:19.989988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Security group rule updated ['91751976-ab00-4687-a70a-b84748ab375c'] Sep 27 04:26:19.990860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Resource SecurityGroupRule deleted: c00e5f46-5ce9-4845-b433-3848daf9ffd2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:19.991300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c00e5f46-5ce9-4845-b433-3848daf9ffd2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:19.991638 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Security group rule updated ['91751976-ab00-4687-a70a-b84748ab375c'] Sep 27 04:26:19.992092 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Resource SecurityGroupRule deleted: cdcf8388-9c85-4000-93ba-ec11b2aa3214 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:19.992658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cdcf8388-9c85-4000-93ba-ec11b2aa3214), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:19.993267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Security group rule updated ['91751976-ab00-4687-a70a-b84748ab375c'] Sep 27 04:26:19.993860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Resource SecurityGroupRule deleted: fdaf583f-8f2a-4d91-a3f0-3b004395b523 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:19.994385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (fdaf583f-8f2a-4d91-a3f0-3b004395b523), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:19.994861 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-72080fd8-cab1-4333-91ee-3248e0ded1c4 admin admin] Security group rule updated ['91751976-ab00-4687-a70a-b84748ab375c'] Sep 27 04:26:20.526012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Resource SecurityGroup deleted: 08c9d646-a17c-45d8-957b-c87185925318 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:20.526472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (08c9d646-a17c-45d8-957b-c87185925318), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:20.527043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('08c9d646-a17c-45d8-957b-c87185925318',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:20.540533 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('08c9d646-a17c-45d8-957b-c87185925318',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:20.541107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Resource SecurityGroupRule deleted: 6314d114-11fc-4309-8982-9523411ee77a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:20.541545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6314d114-11fc-4309-8982-9523411ee77a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:20.541979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Security group rule updated ['08c9d646-a17c-45d8-957b-c87185925318'] Sep 27 04:26:20.542441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Resource SecurityGroupRule deleted: ab02c082-c390-4369-83df-b826a556248f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:20.542863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ab02c082-c390-4369-83df-b826a556248f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:20.543202 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Security group rule updated ['08c9d646-a17c-45d8-957b-c87185925318'] Sep 27 04:26:20.543579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Resource SecurityGroupRule deleted: b88b1382-dfac-48ba-bb44-202af7b63feb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:20.543924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b88b1382-dfac-48ba-bb44-202af7b63feb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:20.544425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Security group rule updated ['08c9d646-a17c-45d8-957b-c87185925318'] Sep 27 04:26:20.544801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Resource SecurityGroupRule deleted: f89005e7-1c74-413f-8778-618e6ebfc6ff {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:20.545150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f89005e7-1c74-413f-8778-618e6ebfc6ff), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:20.545475 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-29815426-ae81-48d1-97d2-916100d07c9f admin admin] Security group rule updated ['08c9d646-a17c-45d8-957b-c87185925318'] Sep 27 04:26:21.697983 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:429 started Sep 27 04:26:21.700576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=525000000,duration_sec=871,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:21.701177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:21.701535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:429 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:23.699422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:430 started Sep 27 04:26:23.702066 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=526000000,duration_sec=873,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:23.702668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:23.703015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:430 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:25.700521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:431 started Sep 27 04:26:25.703429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22daf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=527000000,duration_sec=875,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:25.703992 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:25.704344 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:431 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:27.701630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:432 started Sep 27 04:26:27.703972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22db1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=528000000,duration_sec=877,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:27.704545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:27.704901 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:432 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:26:29.702953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:433 started Sep 27 04:26:29.705656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22db3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=529000000,duration_sec=879,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:29.706257 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:29.706610 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:433 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:31.704269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:434 started Sep 27 04:26:31.706886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22db5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=531000000,duration_sec=881,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:31.707464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:31.707822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:434 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:33.704973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:435 started Sep 27 04:26:33.707242 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22db7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=531000000,duration_sec=883,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:33.707806 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:33.708152 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:435 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:26:35.706064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:436 started Sep 27 04:26:35.708552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22db9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=533000000,duration_sec=885,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:35.709134 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:35.709515 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:436 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:36.299850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-eeb85a35-2cb1-464b-9be8-a81db149dd6f tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource Port deleted: 4e861415-84ce-4923-aa54-770c8249a620 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:36.300236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-eeb85a35-2cb1-464b-9be8-a81db149dd6f tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (4e861415-84ce-4923-aa54-770c8249a620), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:36.300658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-eeb85a35-2cb1-464b-9be8-a81db149dd6f tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group member updated {'54bc43f8-7528-41d7-83a2-7be375d773a9'} Sep 27 04:26:37.707091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:437 started Sep 27 04:26:37.709464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dbb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=534000000,duration_sec=887,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:37.710058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:37.710393 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:437 - starting polling. Elapsed:0.003 Sep 27 04:26:37.712681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:37.714269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 4e861415-84ce-4923-aa54-770c8249a620 not present in bridge br-int Sep 27 04:26:37.714604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:26:37.714889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['4e861415-84ce-4923-aa54-770c8249a620'] Sep 27 04:26:37.715209 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 4e861415-84ce-4923-aa54-770c8249a620 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:26:37.718128 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:437 - port information retrieved. Elapsed:0.011 Sep 27 04:26:37.718460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:437 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:26:38.151912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource SecurityGroup deleted: 54bc43f8-7528-41d7-83a2-7be375d773a9 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:38.152384 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (54bc43f8-7528-41d7-83a2-7be375d773a9), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:38.152917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('54bc43f8-7528-41d7-83a2-7be375d773a9',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:38.166787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('54bc43f8-7528-41d7-83a2-7be375d773a9',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:38.167350 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource SecurityGroupRule deleted: 4e77d63a-b6fb-4476-9c5a-f8dc4233fb84 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:38.167821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4e77d63a-b6fb-4476-9c5a-f8dc4233fb84), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:38.168226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['54bc43f8-7528-41d7-83a2-7be375d773a9'] Sep 27 04:26:38.168703 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource SecurityGroupRule deleted: f8238ebc-b648-454b-be62-31f817d8068a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:38.169175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f8238ebc-b648-454b-be62-31f817d8068a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:38.169506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['54bc43f8-7528-41d7-83a2-7be375d773a9'] Sep 27 04:26:38.169920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource SecurityGroupRule deleted: 973e04f0-c771-4abd-8fff-d9372044561f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:38.170272 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (973e04f0-c771-4abd-8fff-d9372044561f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:38.170595 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['54bc43f8-7528-41d7-83a2-7be375d773a9'] Sep 27 04:26:38.170998 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource SecurityGroupRule deleted: 74b8518a-e3ce-4176-97e0-48fb05e2cb02 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:38.171345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (74b8518a-e3ce-4176-97e0-48fb05e2cb02), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:38.171670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3295339f-f3d7-4a1b-ba63-97f3ff55e19a tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Security group rule updated ['54bc43f8-7528-41d7-83a2-7be375d773a9'] Sep 27 04:26:38.535447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-40519da5-1d1f-4b16-aba4-d8aaa73dd9c1 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Resource Port deleted: 66da99a4-6b5d-4100-a1d8-03fd29f87923 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:38.535973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-40519da5-1d1f-4b16-aba4-d8aaa73dd9c1 tempest-AttachVolumeTestJSON-1830949147 tempest-AttachVolumeTestJSON-1830949147-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (66da99a4-6b5d-4100-a1d8-03fd29f87923), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:39.708108 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:438 started Sep 27 04:26:39.710408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dbd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=535000000,duration_sec=889,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:39.710985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:39.711326 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:438 - starting polling. Elapsed:0.003 Sep 27 04:26:39.713572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:39.715420 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 66da99a4-6b5d-4100-a1d8-03fd29f87923 not present in bridge br-int Sep 27 04:26:39.715545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:26:39.715755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['66da99a4-6b5d-4100-a1d8-03fd29f87923'] Sep 27 04:26:39.716079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 66da99a4-6b5d-4100-a1d8-03fd29f87923 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:26:39.719073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:438 - port information retrieved. Elapsed:0.011 Sep 27 04:26:39.719434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:438 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:26:41.709179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:439 started Sep 27 04:26:41.711454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dbf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=536000000,duration_sec=891,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:41.712027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:41.712378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:439 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:26:43.710453 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:440 started Sep 27 04:26:43.712741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dc1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=537000000,duration_sec=893,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:43.713316 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:43.713672 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:440 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:26:44.181536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fd763e63-c069-43fb-a09c-fd427c1c9f17 admin admin] Resource Port deleted: 3644c780-ef74-4954-a68a-6cc2eadf34ce {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:44.182050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fd763e63-c069-43fb-a09c-fd427c1c9f17 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (3644c780-ef74-4954-a68a-6cc2eadf34ce), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:45.159787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3509d7a-b57b-4cd9-ba1a-4644ec557170 admin admin] Resource Port deleted: b46b0326-166d-45b8-8db2-cac369fbf847 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:45.160431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3509d7a-b57b-4cd9-ba1a-4644ec557170 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (b46b0326-166d-45b8-8db2-cac369fbf847), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:45.251247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["03c06cec-f7c7-4f99-8156-92b63793fac2","delete","qr-3644c780-ef",12,["map",[["attached-mac","fa:16:3e:d1:b9:71"],["iface-id","3644c780-ef74-4954-a68a-6cc2eadf34ce"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:26:45.667159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a6a78d34-90ed-4e05-99eb-6adc9872bf66","delete","qg-b46b0326-16",9,["map",[["attached-mac","fa:16:3e:e9:78:58"],["iface-id","b46b0326-166d-45b8-8db2-cac369fbf847"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:26:45.711796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:441 started Sep 27 04:26:45.856733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ccabe380-c9da-4145-b683-d958a4403267 admin admin] Resource Subnet deleted: 8e579293-c2b5-4786-882a-437ca24df95d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:45.857138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ccabe380-c9da-4145-b683-d958a4403267 admin admin] Publish callbacks [] for Subnet (8e579293-c2b5-4786-882a-437ca24df95d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:45.964830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dc3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=789000000,duration_sec=895,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:45.967750 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:45.968372 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:441 - starting polling. Elapsed:0.257 Sep 27 04:26:45.973104 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:45.979403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22dc5,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:45.981681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22dc7,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:45.982245 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:441 - port information retrieved. Elapsed:0.271 Sep 27 04:26:45.983850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', '133717b2-0788-457d-9fba-bcfb1664cf21', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '72256acd-5a77-4ad3-be5d-043dcec0575b', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '15fb290d-5c6d-48ee-8bbf-dacd88fa8666', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': {'3644c780-ef74-4954-a68a-6cc2eadf34ce', 'b46b0326-166d-45b8-8db2-cac369fbf847'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:26:45.984360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:441 - agent port security group processed in 0.000 Sep 27 04:26:45.986656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:26:45.986861 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'3644c780-ef74-4954-a68a-6cc2eadf34ce', 'b46b0326-166d-45b8-8db2-cac369fbf847'} Sep 27 04:26:45.987363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 8 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:26:46.023030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5c8dc72e-bec4-4d34-9eb8-ba61334e3a48","delete","tap15fb290d-5c",6,["map",[["attached-mac","fa:16:3e:e2:4a:53"],["iface-id","15fb290d-5c6d-48ee-8bbf-dacd88fa8666"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:26:46.055368 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[533a5f0c-711c-48a9-99e1-e1010810256e]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:26:46.056284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'3644c780-ef74-4954-a68a-6cc2eadf34ce', 'b46b0326-166d-45b8-8db2-cac369fbf847'} removed Sep 27 04:26:46.127774 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:26:46.129180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:441 - treat_devices_removed completed in 0.142 Sep 27 04:26:46.129647 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:441 - ports processed. Elapsed:0.418 Sep 27 04:26:46.130395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:441 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.419 Sep 27 04:26:46.183981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-70834a92-49e7-45e9-bf0e-0477365b3b5f admin admin] Resource Port deleted: 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:46.185689 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-70834a92-49e7-45e9-bf0e-0477365b3b5f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (15fb290d-5c6d-48ee-8bbf-dacd88fa8666), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:46.357478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4fbf4213-b7b3-4e83-88f8-e38b20c4bb2b None None] Resource Port deleted: 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:46.358316 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4fbf4213-b7b3-4e83-88f8-e38b20c4bb2b None None] Skipped duplicate delete event for 15fb290d-5c6d-48ee-8bbf-dacd88fa8666 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 27 04:26:46.441568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-70834a92-49e7-45e9-bf0e-0477365b3b5f admin admin] Resource Network deleted: a72f6105-d258-45cb-a84d-18590bef93c2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:46.442056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-70834a92-49e7-45e9-bf0e-0477365b3b5f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (a72f6105-d258-45cb-a84d-18590bef93c2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:46.743700 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Resource SecurityGroup deleted: a739030a-6e60-49f1-b474-2e81a8470511 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:46.744169 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (a739030a-6e60-49f1-b474-2e81a8470511), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:46.744563 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a739030a-6e60-49f1-b474-2e81a8470511',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:46.765018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a739030a-6e60-49f1-b474-2e81a8470511',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:46.765482 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Resource SecurityGroupRule deleted: 283b54c7-e4c1-41f8-bbd0-5c875a7c037c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:46.766352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (283b54c7-e4c1-41f8-bbd0-5c875a7c037c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:46.766696 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Security group rule updated ['a739030a-6e60-49f1-b474-2e81a8470511'] Sep 27 04:26:46.767091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Resource SecurityGroupRule deleted: 6e20e452-cb14-4a72-aaa6-86c1f8f5c345 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:46.767441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6e20e452-cb14-4a72-aaa6-86c1f8f5c345), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:46.767817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Security group rule updated ['a739030a-6e60-49f1-b474-2e81a8470511'] Sep 27 04:26:46.768196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Resource SecurityGroupRule deleted: 76f16f17-ae08-4461-a629-0294d44f0448 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:46.768538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (76f16f17-ae08-4461-a629-0294d44f0448), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:46.768977 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Security group rule updated ['a739030a-6e60-49f1-b474-2e81a8470511'] Sep 27 04:26:46.769350 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Resource SecurityGroupRule deleted: c2c16423-d655-415a-8ef1-148d35820b20 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:46.769692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c2c16423-d655-415a-8ef1-148d35820b20), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:46.770461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d4fb9988-6cc0-4fc8-82dd-a8b9b4a9ccb0 admin admin] Security group rule updated ['a739030a-6e60-49f1-b474-2e81a8470511'] Sep 27 04:26:47.712814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:442 started Sep 27 04:26:47.715349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dc9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=539000000,duration_sec=897,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:47.715936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:47.716355 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:442 - starting polling. Elapsed:0.004 Sep 27 04:26:47.718809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:47.725989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22dcb,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:47.725989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:442 - port information retrieved. Elapsed:0.011 Sep 27 04:26:47.725989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', '133717b2-0788-457d-9fba-bcfb1664cf21', 'd38ba25f-11e0-4272-a046-108afa9fa96c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '72256acd-5a77-4ad3-be5d-043dcec0575b', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': {'15fb290d-5c6d-48ee-8bbf-dacd88fa8666'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:26:47.726285 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:442 - agent port security group processed in 0.000 Sep 27 04:26:47.726285 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:26:47.726493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'15fb290d-5c6d-48ee-8bbf-dacd88fa8666'} Sep 27 04:26:47.726964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:26:47.764138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[db19e9c4-d1af-4e51-862b-4171b787fce7]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:26:47.764806 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'15fb290d-5c6d-48ee-8bbf-dacd88fa8666'} removed Sep 27 04:26:47.792409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:26:47.792916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 4 from net-id = a72f6105-d258-45cb-a84d-18590bef93c2, seg-id = 113 Sep 27 04:26:47.797521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32eb9,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:47.800146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc22dcd,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4209}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:47.800539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:442 - treat_devices_removed completed in 0.074 Sep 27 04:26:47.801084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:442 - ports processed. Elapsed:0.088 Sep 27 04:26:47.801423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:442 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.089 Sep 27 04:26:48.691647 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:48Z,description='Default security group',id=856a48be-2b67-4d50-a804-18f97695fa19,is_default=True,name='default',project_id='1c32dbf98bb9458c8ee9484fde9ba309',revision_number=1,rules=[SecurityGroupRule(419b23e7-9777-4296-9d80-f6197ba609aa),SecurityGroupRule(61d5e42a-c641-467a-b92a-b08652b5f2fe),SecurityGroupRule(8356be5d-f9f0-497f-9d42-122ceaeb4d47),SecurityGroupRule(b4d23fd2-adac-4b00-a7e0-29053ad68cb1)],shared=False,stateful=True,updated_at=2022-09-27T04:26:48Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:48.692034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (856a48be-2b67-4d50-a804-18f97695fa19), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:48.692910 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:48Z,description=,direction='egress',ethertype='IPv6',id=419b23e7-9777-4296-9d80-f6197ba609aa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c32dbf98bb9458c8ee9484fde9ba309',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=856a48be-2b67-4d50-a804-18f97695fa19,updated_at=2022-09-27T04:26:48Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:48.693276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (419b23e7-9777-4296-9d80-f6197ba609aa), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:48.693636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Security group rule updated ['856a48be-2b67-4d50-a804-18f97695fa19'] Sep 27 04:26:48.694342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:48Z,description=,direction='ingress',ethertype='IPv4',id=61d5e42a-c641-467a-b92a-b08652b5f2fe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c32dbf98bb9458c8ee9484fde9ba309',protocol=,remote_address_group_id=,remote_group_id=856a48be-2b67-4d50-a804-18f97695fa19,remote_ip_prefix=,revision_number=0,security_group_id=856a48be-2b67-4d50-a804-18f97695fa19,updated_at=2022-09-27T04:26:48Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:48.694701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (61d5e42a-c641-467a-b92a-b08652b5f2fe), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:48.695034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Security group rule updated ['856a48be-2b67-4d50-a804-18f97695fa19'] Sep 27 04:26:48.695717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:48Z,description=,direction='egress',ethertype='IPv4',id=8356be5d-f9f0-497f-9d42-122ceaeb4d47,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c32dbf98bb9458c8ee9484fde9ba309',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=856a48be-2b67-4d50-a804-18f97695fa19,updated_at=2022-09-27T04:26:48Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:48.696075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8356be5d-f9f0-497f-9d42-122ceaeb4d47), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:48.696527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Security group rule updated ['856a48be-2b67-4d50-a804-18f97695fa19'] Sep 27 04:26:48.697191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:48Z,description=,direction='ingress',ethertype='IPv6',id=b4d23fd2-adac-4b00-a7e0-29053ad68cb1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1c32dbf98bb9458c8ee9484fde9ba309',protocol=,remote_address_group_id=,remote_group_id=856a48be-2b67-4d50-a804-18f97695fa19,remote_ip_prefix=,revision_number=0,security_group_id=856a48be-2b67-4d50-a804-18f97695fa19,updated_at=2022-09-27T04:26:48Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:48.697547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b4d23fd2-adac-4b00-a7e0-29053ad68cb1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:48.697924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7f0ee310-c996-4f7f-b91c-e7fee35c01bc admin admin] Security group rule updated ['856a48be-2b67-4d50-a804-18f97695fa19'] Sep 27 04:26:48.824922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Resource SecurityGroup deleted: 856a48be-2b67-4d50-a804-18f97695fa19 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:48.825530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (856a48be-2b67-4d50-a804-18f97695fa19), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:48.825856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('856a48be-2b67-4d50-a804-18f97695fa19',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:48.839858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('856a48be-2b67-4d50-a804-18f97695fa19',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:48.840350 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Resource SecurityGroupRule deleted: 419b23e7-9777-4296-9d80-f6197ba609aa {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:48.840719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (419b23e7-9777-4296-9d80-f6197ba609aa), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:48.841080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Security group rule updated ['856a48be-2b67-4d50-a804-18f97695fa19'] Sep 27 04:26:48.841475 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Resource SecurityGroupRule deleted: 61d5e42a-c641-467a-b92a-b08652b5f2fe {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:48.841866 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (61d5e42a-c641-467a-b92a-b08652b5f2fe), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:48.842181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Security group rule updated ['856a48be-2b67-4d50-a804-18f97695fa19'] Sep 27 04:26:48.842584 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Resource SecurityGroupRule deleted: 8356be5d-f9f0-497f-9d42-122ceaeb4d47 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:48.842930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (8356be5d-f9f0-497f-9d42-122ceaeb4d47), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:48.843610 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Security group rule updated ['856a48be-2b67-4d50-a804-18f97695fa19'] Sep 27 04:26:48.844187 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Resource SecurityGroupRule deleted: b4d23fd2-adac-4b00-a7e0-29053ad68cb1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:48.845078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b4d23fd2-adac-4b00-a7e0-29053ad68cb1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:48.845402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-35a368c0-af48-46c0-a4dd-d454b2cc14bb admin admin] Security group rule updated ['856a48be-2b67-4d50-a804-18f97695fa19'] Sep 27 04:26:49.215969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:49Z,description='Default security group',id=411e699c-3733-41b4-ac4e-2c13185c1cf8,is_default=True,name='default',project_id='85f605240d5845b6a9aa1583e6314e48',revision_number=1,rules=[SecurityGroupRule(0c287b8a-adf5-421b-86f6-cedbd460e17c),SecurityGroupRule(57fa8c9a-4bc3-4f07-821c-6cdb2c7eb26b),SecurityGroupRule(a8d3f5db-2eee-4999-93ae-9d23580fc3c9),SecurityGroupRule(d155a349-3cf4-40dd-89f5-cc76dc6cd686)],shared=False,stateful=True,updated_at=2022-09-27T04:26:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:49.216363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (411e699c-3733-41b4-ac4e-2c13185c1cf8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:49.216992 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:49Z,description=,direction='egress',ethertype='IPv4',id=0c287b8a-adf5-421b-86f6-cedbd460e17c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85f605240d5845b6a9aa1583e6314e48',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=411e699c-3733-41b4-ac4e-2c13185c1cf8,updated_at=2022-09-27T04:26:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:49.217388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0c287b8a-adf5-421b-86f6-cedbd460e17c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:49.217730 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Security group rule updated ['411e699c-3733-41b4-ac4e-2c13185c1cf8'] Sep 27 04:26:49.218441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:49Z,description=,direction='ingress',ethertype='IPv4',id=57fa8c9a-4bc3-4f07-821c-6cdb2c7eb26b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85f605240d5845b6a9aa1583e6314e48',protocol=,remote_address_group_id=,remote_group_id=411e699c-3733-41b4-ac4e-2c13185c1cf8,remote_ip_prefix=,revision_number=0,security_group_id=411e699c-3733-41b4-ac4e-2c13185c1cf8,updated_at=2022-09-27T04:26:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:49.218804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (57fa8c9a-4bc3-4f07-821c-6cdb2c7eb26b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:49.219139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Security group rule updated ['411e699c-3733-41b4-ac4e-2c13185c1cf8'] Sep 27 04:26:49.220427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:49Z,description=,direction='egress',ethertype='IPv6',id=a8d3f5db-2eee-4999-93ae-9d23580fc3c9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85f605240d5845b6a9aa1583e6314e48',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=411e699c-3733-41b4-ac4e-2c13185c1cf8,updated_at=2022-09-27T04:26:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:49.220816 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a8d3f5db-2eee-4999-93ae-9d23580fc3c9), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:49.221153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Security group rule updated ['411e699c-3733-41b4-ac4e-2c13185c1cf8'] Sep 27 04:26:49.221875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:49Z,description=,direction='ingress',ethertype='IPv6',id=d155a349-3cf4-40dd-89f5-cc76dc6cd686,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85f605240d5845b6a9aa1583e6314e48',protocol=,remote_address_group_id=,remote_group_id=411e699c-3733-41b4-ac4e-2c13185c1cf8,remote_ip_prefix=,revision_number=0,security_group_id=411e699c-3733-41b4-ac4e-2c13185c1cf8,updated_at=2022-09-27T04:26:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:49.222236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d155a349-3cf4-40dd-89f5-cc76dc6cd686), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:49.222570 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-cbcc5198-a916-4144-b6ff-30836aa68bb5 admin admin] Security group rule updated ['411e699c-3733-41b4-ac4e-2c13185c1cf8'] Sep 27 04:26:49.359525 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Resource SecurityGroup deleted: 411e699c-3733-41b4-ac4e-2c13185c1cf8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:49.360232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (411e699c-3733-41b4-ac4e-2c13185c1cf8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:49.360729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('411e699c-3733-41b4-ac4e-2c13185c1cf8',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:49.373321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('411e699c-3733-41b4-ac4e-2c13185c1cf8',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:49.374016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Resource SecurityGroupRule deleted: 0c287b8a-adf5-421b-86f6-cedbd460e17c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:49.374398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0c287b8a-adf5-421b-86f6-cedbd460e17c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:49.374765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Security group rule updated ['411e699c-3733-41b4-ac4e-2c13185c1cf8'] Sep 27 04:26:49.375162 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Resource SecurityGroupRule deleted: 57fa8c9a-4bc3-4f07-821c-6cdb2c7eb26b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:49.375517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (57fa8c9a-4bc3-4f07-821c-6cdb2c7eb26b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:49.376390 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Security group rule updated ['411e699c-3733-41b4-ac4e-2c13185c1cf8'] Sep 27 04:26:49.376907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Resource SecurityGroupRule deleted: a8d3f5db-2eee-4999-93ae-9d23580fc3c9 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:49.377286 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a8d3f5db-2eee-4999-93ae-9d23580fc3c9), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:49.377735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Security group rule updated ['411e699c-3733-41b4-ac4e-2c13185c1cf8'] Sep 27 04:26:49.378159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Resource SecurityGroupRule deleted: d155a349-3cf4-40dd-89f5-cc76dc6cd686 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:49.378606 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d155a349-3cf4-40dd-89f5-cc76dc6cd686), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:49.378817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6d5b9bd8-75a8-4eba-8aa8-a76709bbe584 admin admin] Security group rule updated ['411e699c-3733-41b4-ac4e-2c13185c1cf8'] Sep 27 04:26:49.714041 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:443 started Sep 27 04:26:49.716566 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dcf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=541000000,duration_sec=899,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:49.717147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:49.717503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:443 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:50.998689 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:50Z,description='Default security group',id=f99f822c-e5d6-4c2f-9559-ee04bc848ed1,is_default=True,name='default',project_id='80ffbd2c0065498eabe1a93e2e3e0111',revision_number=1,rules=[SecurityGroupRule(0a688097-75f3-428c-a684-55611281ea3b),SecurityGroupRule(1455e4b6-7cdf-47bf-9003-8720f2d8ea07),SecurityGroupRule(9e0e491d-c1f4-41b5-b4fe-56a606483ca1),SecurityGroupRule(ac8226e6-e1f6-432b-bb87-508250700f20)],shared=False,stateful=True,updated_at=2022-09-27T04:26:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:50.999270 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (f99f822c-e5d6-4c2f-9559-ee04bc848ed1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:50.999699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:50Z,description=,direction='ingress',ethertype='IPv6',id=0a688097-75f3-428c-a684-55611281ea3b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='80ffbd2c0065498eabe1a93e2e3e0111',protocol=,remote_address_group_id=,remote_group_id=f99f822c-e5d6-4c2f-9559-ee04bc848ed1,remote_ip_prefix=,revision_number=0,security_group_id=f99f822c-e5d6-4c2f-9559-ee04bc848ed1,updated_at=2022-09-27T04:26:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:51.000281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0a688097-75f3-428c-a684-55611281ea3b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.001399 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Security group rule updated ['f99f822c-e5d6-4c2f-9559-ee04bc848ed1'] Sep 27 04:26:51.002113 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:50Z,description=,direction='ingress',ethertype='IPv4',id=1455e4b6-7cdf-47bf-9003-8720f2d8ea07,normalized_cidr=None,port_range_max=,port_range_min=,project_id='80ffbd2c0065498eabe1a93e2e3e0111',protocol=,remote_address_group_id=,remote_group_id=f99f822c-e5d6-4c2f-9559-ee04bc848ed1,remote_ip_prefix=,revision_number=0,security_group_id=f99f822c-e5d6-4c2f-9559-ee04bc848ed1,updated_at=2022-09-27T04:26:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:51.002473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1455e4b6-7cdf-47bf-9003-8720f2d8ea07), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.002809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Security group rule updated ['f99f822c-e5d6-4c2f-9559-ee04bc848ed1'] Sep 27 04:26:51.003533 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:50Z,description=,direction='egress',ethertype='IPv6',id=9e0e491d-c1f4-41b5-b4fe-56a606483ca1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='80ffbd2c0065498eabe1a93e2e3e0111',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f99f822c-e5d6-4c2f-9559-ee04bc848ed1,updated_at=2022-09-27T04:26:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:51.003887 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9e0e491d-c1f4-41b5-b4fe-56a606483ca1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.004400 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Security group rule updated ['f99f822c-e5d6-4c2f-9559-ee04bc848ed1'] Sep 27 04:26:51.005069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:50Z,description=,direction='egress',ethertype='IPv4',id=ac8226e6-e1f6-432b-bb87-508250700f20,normalized_cidr=None,port_range_max=,port_range_min=,project_id='80ffbd2c0065498eabe1a93e2e3e0111',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f99f822c-e5d6-4c2f-9559-ee04bc848ed1,updated_at=2022-09-27T04:26:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:51.005426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ac8226e6-e1f6-432b-bb87-508250700f20), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.005777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-37169138-d2b6-48ac-8868-9e349a440b48 admin admin] Security group rule updated ['f99f822c-e5d6-4c2f-9559-ee04bc848ed1'] Sep 27 04:26:51.144468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Resource SecurityGroup deleted: f99f822c-e5d6-4c2f-9559-ee04bc848ed1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:51.144932 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (f99f822c-e5d6-4c2f-9559-ee04bc848ed1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.145466 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f99f822c-e5d6-4c2f-9559-ee04bc848ed1',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:51.159333 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f99f822c-e5d6-4c2f-9559-ee04bc848ed1',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:51.159828 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Resource SecurityGroupRule deleted: 0a688097-75f3-428c-a684-55611281ea3b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:51.160204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0a688097-75f3-428c-a684-55611281ea3b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.160566 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Security group rule updated ['f99f822c-e5d6-4c2f-9559-ee04bc848ed1'] Sep 27 04:26:51.160979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Resource SecurityGroupRule deleted: 1455e4b6-7cdf-47bf-9003-8720f2d8ea07 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:51.161400 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1455e4b6-7cdf-47bf-9003-8720f2d8ea07), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.162012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Security group rule updated ['f99f822c-e5d6-4c2f-9559-ee04bc848ed1'] Sep 27 04:26:51.162522 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Resource SecurityGroupRule deleted: 9e0e491d-c1f4-41b5-b4fe-56a606483ca1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:51.162858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9e0e491d-c1f4-41b5-b4fe-56a606483ca1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.163310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Security group rule updated ['f99f822c-e5d6-4c2f-9559-ee04bc848ed1'] Sep 27 04:26:51.163729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Resource SecurityGroupRule deleted: ac8226e6-e1f6-432b-bb87-508250700f20 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:51.164368 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ac8226e6-e1f6-432b-bb87-508250700f20), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.164897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fbc951e4-42ca-4f6c-8755-fec06f07c826 admin admin] Security group rule updated ['f99f822c-e5d6-4c2f-9559-ee04bc848ed1'] Sep 27 04:26:51.530520 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:51Z,description='Default security group',id=8f922c2e-bb01-44c3-ac6e-706e124122d2,is_default=True,name='default',project_id='6ebc46fe189d440599fb32a60fa430c2',revision_number=1,rules=[SecurityGroupRule(277d0083-8943-4a70-ab03-ef2f26aa47eb),SecurityGroupRule(2b32226f-d453-4804-bc34-2b3410af6920),SecurityGroupRule(a7a3317a-2eaf-42aa-87a9-c293b22d90d8),SecurityGroupRule(d41c6c44-6e8a-4fe9-bef7-0461d2ed2c07)],shared=False,stateful=True,updated_at=2022-09-27T04:26:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:51.530919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (8f922c2e-bb01-44c3-ac6e-706e124122d2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.531545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:51Z,description=,direction='ingress',ethertype='IPv6',id=277d0083-8943-4a70-ab03-ef2f26aa47eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6ebc46fe189d440599fb32a60fa430c2',protocol=,remote_address_group_id=,remote_group_id=8f922c2e-bb01-44c3-ac6e-706e124122d2,remote_ip_prefix=,revision_number=0,security_group_id=8f922c2e-bb01-44c3-ac6e-706e124122d2,updated_at=2022-09-27T04:26:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:51.531956 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (277d0083-8943-4a70-ab03-ef2f26aa47eb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.532290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Security group rule updated ['8f922c2e-bb01-44c3-ac6e-706e124122d2'] Sep 27 04:26:51.532955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:51Z,description=,direction='egress',ethertype='IPv6',id=2b32226f-d453-4804-bc34-2b3410af6920,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6ebc46fe189d440599fb32a60fa430c2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8f922c2e-bb01-44c3-ac6e-706e124122d2,updated_at=2022-09-27T04:26:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:51.533305 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2b32226f-d453-4804-bc34-2b3410af6920), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.533762 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Security group rule updated ['8f922c2e-bb01-44c3-ac6e-706e124122d2'] Sep 27 04:26:51.534465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:51Z,description=,direction='egress',ethertype='IPv4',id=a7a3317a-2eaf-42aa-87a9-c293b22d90d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6ebc46fe189d440599fb32a60fa430c2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8f922c2e-bb01-44c3-ac6e-706e124122d2,updated_at=2022-09-27T04:26:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:51.534814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a7a3317a-2eaf-42aa-87a9-c293b22d90d8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.535137 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Security group rule updated ['8f922c2e-bb01-44c3-ac6e-706e124122d2'] Sep 27 04:26:51.535786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:51Z,description=,direction='ingress',ethertype='IPv4',id=d41c6c44-6e8a-4fe9-bef7-0461d2ed2c07,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6ebc46fe189d440599fb32a60fa430c2',protocol=,remote_address_group_id=,remote_group_id=8f922c2e-bb01-44c3-ac6e-706e124122d2,remote_ip_prefix=,revision_number=0,security_group_id=8f922c2e-bb01-44c3-ac6e-706e124122d2,updated_at=2022-09-27T04:26:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:51.536132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d41c6c44-6e8a-4fe9-bef7-0461d2ed2c07), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.536526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8cce7f8a-5d2c-4ceb-b476-8196ad63f20c admin admin] Security group rule updated ['8f922c2e-bb01-44c3-ac6e-706e124122d2'] Sep 27 04:26:51.661257 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Resource SecurityGroup deleted: 8f922c2e-bb01-44c3-ac6e-706e124122d2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:51.661773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (8f922c2e-bb01-44c3-ac6e-706e124122d2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.662331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8f922c2e-bb01-44c3-ac6e-706e124122d2',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:51.675960 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8f922c2e-bb01-44c3-ac6e-706e124122d2',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:51.676418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Resource SecurityGroupRule deleted: 277d0083-8943-4a70-ab03-ef2f26aa47eb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:51.676793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (277d0083-8943-4a70-ab03-ef2f26aa47eb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.677133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Security group rule updated ['8f922c2e-bb01-44c3-ac6e-706e124122d2'] Sep 27 04:26:51.677773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Resource SecurityGroupRule deleted: 2b32226f-d453-4804-bc34-2b3410af6920 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:51.678171 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2b32226f-d453-4804-bc34-2b3410af6920), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.678482 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Security group rule updated ['8f922c2e-bb01-44c3-ac6e-706e124122d2'] Sep 27 04:26:51.678845 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Resource SecurityGroupRule deleted: a7a3317a-2eaf-42aa-87a9-c293b22d90d8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:51.679194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a7a3317a-2eaf-42aa-87a9-c293b22d90d8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.679523 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Security group rule updated ['8f922c2e-bb01-44c3-ac6e-706e124122d2'] Sep 27 04:26:51.679901 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Resource SecurityGroupRule deleted: d41c6c44-6e8a-4fe9-bef7-0461d2ed2c07 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:51.680249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d41c6c44-6e8a-4fe9-bef7-0461d2ed2c07), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:51.680576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d9a9e25d-b4eb-48ef-9bcf-e7af66c1d633 admin admin] Security group rule updated ['8f922c2e-bb01-44c3-ac6e-706e124122d2'] Sep 27 04:26:51.714900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:444 started Sep 27 04:26:51.717237 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dd1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=541000000,duration_sec=901,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:51.718449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:51.718990 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:444 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:53.715454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:445 started Sep 27 04:26:53.718411 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dd3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=542000000,duration_sec=903,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:53.718991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:53.719665 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:445 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:54.417007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:54Z,description='Default security group',id=03d6eea3-8207-4d77-97e8-4af409d296c8,is_default=True,name='default',project_id='c56091ecf8c641bab1ac29aa633dfb07',revision_number=1,rules=[SecurityGroupRule(533cd204-08eb-46ee-af84-acc37b757886),SecurityGroupRule(6976471b-84de-4f6c-8912-28f0ba72ed96),SecurityGroupRule(700c705b-fc7a-48f7-89a9-7321a6f4a363),SecurityGroupRule(ed9bcb3a-3433-4d0c-980b-3aa4cc013c4b)],shared=False,stateful=True,updated_at=2022-09-27T04:26:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:54.417394 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (03d6eea3-8207-4d77-97e8-4af409d296c8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:54.418165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:54Z,description=,direction='egress',ethertype='IPv4',id=533cd204-08eb-46ee-af84-acc37b757886,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c56091ecf8c641bab1ac29aa633dfb07',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=03d6eea3-8207-4d77-97e8-4af409d296c8,updated_at=2022-09-27T04:26:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:54.418604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (533cd204-08eb-46ee-af84-acc37b757886), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:54.419017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Security group rule updated ['03d6eea3-8207-4d77-97e8-4af409d296c8'] Sep 27 04:26:54.419763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:54Z,description=,direction='egress',ethertype='IPv6',id=6976471b-84de-4f6c-8912-28f0ba72ed96,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c56091ecf8c641bab1ac29aa633dfb07',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=03d6eea3-8207-4d77-97e8-4af409d296c8,updated_at=2022-09-27T04:26:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:54.420192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6976471b-84de-4f6c-8912-28f0ba72ed96), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:54.420593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Security group rule updated ['03d6eea3-8207-4d77-97e8-4af409d296c8'] Sep 27 04:26:54.421327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:54Z,description=,direction='ingress',ethertype='IPv6',id=700c705b-fc7a-48f7-89a9-7321a6f4a363,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c56091ecf8c641bab1ac29aa633dfb07',protocol=,remote_address_group_id=,remote_group_id=03d6eea3-8207-4d77-97e8-4af409d296c8,remote_ip_prefix=,revision_number=0,security_group_id=03d6eea3-8207-4d77-97e8-4af409d296c8,updated_at=2022-09-27T04:26:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:54.421770 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (700c705b-fc7a-48f7-89a9-7321a6f4a363), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:54.422169 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Security group rule updated ['03d6eea3-8207-4d77-97e8-4af409d296c8'] Sep 27 04:26:54.422942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:54Z,description=,direction='ingress',ethertype='IPv4',id=ed9bcb3a-3433-4d0c-980b-3aa4cc013c4b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c56091ecf8c641bab1ac29aa633dfb07',protocol=,remote_address_group_id=,remote_group_id=03d6eea3-8207-4d77-97e8-4af409d296c8,remote_ip_prefix=,revision_number=0,security_group_id=03d6eea3-8207-4d77-97e8-4af409d296c8,updated_at=2022-09-27T04:26:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:54.423371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ed9bcb3a-3433-4d0c-980b-3aa4cc013c4b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:54.423704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-fcffafdb-a909-41d4-b1f5-113106b1f7ab admin admin] Security group rule updated ['03d6eea3-8207-4d77-97e8-4af409d296c8'] Sep 27 04:26:54.780906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Resource SecurityGroup deleted: 03d6eea3-8207-4d77-97e8-4af409d296c8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:54.781526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (03d6eea3-8207-4d77-97e8-4af409d296c8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:54.781726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('03d6eea3-8207-4d77-97e8-4af409d296c8',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:54.794008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('03d6eea3-8207-4d77-97e8-4af409d296c8',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:54.794467 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Resource SecurityGroupRule deleted: 533cd204-08eb-46ee-af84-acc37b757886 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:54.794830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (533cd204-08eb-46ee-af84-acc37b757886), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:54.795345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Security group rule updated ['03d6eea3-8207-4d77-97e8-4af409d296c8'] Sep 27 04:26:54.795741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Resource SecurityGroupRule deleted: 6976471b-84de-4f6c-8912-28f0ba72ed96 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:54.796090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6976471b-84de-4f6c-8912-28f0ba72ed96), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:54.796413 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Security group rule updated ['03d6eea3-8207-4d77-97e8-4af409d296c8'] Sep 27 04:26:54.796780 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Resource SecurityGroupRule deleted: 700c705b-fc7a-48f7-89a9-7321a6f4a363 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:54.797131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (700c705b-fc7a-48f7-89a9-7321a6f4a363), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:54.797450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Security group rule updated ['03d6eea3-8207-4d77-97e8-4af409d296c8'] Sep 27 04:26:54.797935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Resource SecurityGroupRule deleted: ed9bcb3a-3433-4d0c-980b-3aa4cc013c4b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:54.798219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ed9bcb3a-3433-4d0c-980b-3aa4cc013c4b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:54.798536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-32478649-0e16-4910-a810-25ff04913d48 admin admin] Security group rule updated ['03d6eea3-8207-4d77-97e8-4af409d296c8'] Sep 27 04:26:55.180919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:55Z,description='Default security group',id=1d55535e-e88f-4feb-971f-234408e4adf0,is_default=True,name='default',project_id='fd11e5581c884623827d5b683c0ac58a',revision_number=1,rules=[SecurityGroupRule(26258158-e4f2-4298-b00c-944de95e2604),SecurityGroupRule(53fdaf18-3075-4480-a744-70e31f3aacd0),SecurityGroupRule(f8b9d407-49b5-41fb-8922-bf2268355bcd),SecurityGroupRule(fa80ba84-df74-4e96-b985-0ee2ac548228)],shared=False,stateful=True,updated_at=2022-09-27T04:26:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:55.181311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (1d55535e-e88f-4feb-971f-234408e4adf0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:55.182001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:55Z,description=,direction='ingress',ethertype='IPv6',id=26258158-e4f2-4298-b00c-944de95e2604,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fd11e5581c884623827d5b683c0ac58a',protocol=,remote_address_group_id=,remote_group_id=1d55535e-e88f-4feb-971f-234408e4adf0,remote_ip_prefix=,revision_number=0,security_group_id=1d55535e-e88f-4feb-971f-234408e4adf0,updated_at=2022-09-27T04:26:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:55.182392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (26258158-e4f2-4298-b00c-944de95e2604), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:55.182724 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Security group rule updated ['1d55535e-e88f-4feb-971f-234408e4adf0'] Sep 27 04:26:55.183426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:55Z,description=,direction='egress',ethertype='IPv4',id=53fdaf18-3075-4480-a744-70e31f3aacd0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fd11e5581c884623827d5b683c0ac58a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1d55535e-e88f-4feb-971f-234408e4adf0,updated_at=2022-09-27T04:26:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:55.183856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (53fdaf18-3075-4480-a744-70e31f3aacd0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:55.184197 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Security group rule updated ['1d55535e-e88f-4feb-971f-234408e4adf0'] Sep 27 04:26:55.184953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:55Z,description=,direction='ingress',ethertype='IPv4',id=f8b9d407-49b5-41fb-8922-bf2268355bcd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fd11e5581c884623827d5b683c0ac58a',protocol=,remote_address_group_id=,remote_group_id=1d55535e-e88f-4feb-971f-234408e4adf0,remote_ip_prefix=,revision_number=0,security_group_id=1d55535e-e88f-4feb-971f-234408e4adf0,updated_at=2022-09-27T04:26:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:55.185310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f8b9d407-49b5-41fb-8922-bf2268355bcd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:55.185788 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Security group rule updated ['1d55535e-e88f-4feb-971f-234408e4adf0'] Sep 27 04:26:55.186461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:55Z,description=,direction='egress',ethertype='IPv6',id=fa80ba84-df74-4e96-b985-0ee2ac548228,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fd11e5581c884623827d5b683c0ac58a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1d55535e-e88f-4feb-971f-234408e4adf0,updated_at=2022-09-27T04:26:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:55.186832 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (fa80ba84-df74-4e96-b985-0ee2ac548228), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:55.187439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ab40594c-b1d1-4376-9e77-1c7765b901b3 admin admin] Security group rule updated ['1d55535e-e88f-4feb-971f-234408e4adf0'] Sep 27 04:26:55.316782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Resource SecurityGroup deleted: 1d55535e-e88f-4feb-971f-234408e4adf0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:55.317230 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (1d55535e-e88f-4feb-971f-234408e4adf0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:55.317699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1d55535e-e88f-4feb-971f-234408e4adf0',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:55.332544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1d55535e-e88f-4feb-971f-234408e4adf0',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:55.333015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Resource SecurityGroupRule deleted: 26258158-e4f2-4298-b00c-944de95e2604 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:55.333386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (26258158-e4f2-4298-b00c-944de95e2604), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:55.333724 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Security group rule updated ['1d55535e-e88f-4feb-971f-234408e4adf0'] Sep 27 04:26:55.334183 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Resource SecurityGroupRule deleted: 53fdaf18-3075-4480-a744-70e31f3aacd0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:55.334535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (53fdaf18-3075-4480-a744-70e31f3aacd0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:55.335001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Security group rule updated ['1d55535e-e88f-4feb-971f-234408e4adf0'] Sep 27 04:26:55.335432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Resource SecurityGroupRule deleted: f8b9d407-49b5-41fb-8922-bf2268355bcd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:55.335786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f8b9d407-49b5-41fb-8922-bf2268355bcd), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:55.336108 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Security group rule updated ['1d55535e-e88f-4feb-971f-234408e4adf0'] Sep 27 04:26:55.336503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Resource SecurityGroupRule deleted: fa80ba84-df74-4e96-b985-0ee2ac548228 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:55.336856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (fa80ba84-df74-4e96-b985-0ee2ac548228), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:55.337177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d80d25f6-b09d-4e69-a5bb-23381d615fd4 admin admin] Security group rule updated ['1d55535e-e88f-4feb-971f-234408e4adf0'] Sep 27 04:26:55.717166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:446 started Sep 27 04:26:55.721073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dd5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=545000000,duration_sec=905,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:55.721786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:55.722219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:446 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:26:57.210906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:57Z,description='Default security group',id=dcf35fef-f4ac-4946-bdac-2958f76c4bec,is_default=True,name='default',project_id='b718062f86b14cc7b1ce38b8c46567bd',revision_number=1,rules=[SecurityGroupRule(37750641-907e-4341-b7f4-243f4ef1552d),SecurityGroupRule(462ff74a-cf15-4811-a652-dd90d51c87ba),SecurityGroupRule(9b4edf27-5297-42fa-9b47-171a1589e693),SecurityGroupRule(e8b29fc1-6b0b-444e-a670-1e5febb7ec7b)],shared=False,stateful=True,updated_at=2022-09-27T04:26:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:57.211458 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (dcf35fef-f4ac-4946-bdac-2958f76c4bec), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.211929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:57Z,description=,direction='ingress',ethertype='IPv6',id=37750641-907e-4341-b7f4-243f4ef1552d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b718062f86b14cc7b1ce38b8c46567bd',protocol=,remote_address_group_id=,remote_group_id=dcf35fef-f4ac-4946-bdac-2958f76c4bec,remote_ip_prefix=,revision_number=0,security_group_id=dcf35fef-f4ac-4946-bdac-2958f76c4bec,updated_at=2022-09-27T04:26:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:57.212293 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (37750641-907e-4341-b7f4-243f4ef1552d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.212667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Security group rule updated ['dcf35fef-f4ac-4946-bdac-2958f76c4bec'] Sep 27 04:26:57.213351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:57Z,description=,direction='ingress',ethertype='IPv4',id=462ff74a-cf15-4811-a652-dd90d51c87ba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b718062f86b14cc7b1ce38b8c46567bd',protocol=,remote_address_group_id=,remote_group_id=dcf35fef-f4ac-4946-bdac-2958f76c4bec,remote_ip_prefix=,revision_number=0,security_group_id=dcf35fef-f4ac-4946-bdac-2958f76c4bec,updated_at=2022-09-27T04:26:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:57.213713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (462ff74a-cf15-4811-a652-dd90d51c87ba), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.214069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Security group rule updated ['dcf35fef-f4ac-4946-bdac-2958f76c4bec'] Sep 27 04:26:57.214761 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:57Z,description=,direction='egress',ethertype='IPv4',id=9b4edf27-5297-42fa-9b47-171a1589e693,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b718062f86b14cc7b1ce38b8c46567bd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dcf35fef-f4ac-4946-bdac-2958f76c4bec,updated_at=2022-09-27T04:26:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:57.215119 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9b4edf27-5297-42fa-9b47-171a1589e693), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.215455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Security group rule updated ['dcf35fef-f4ac-4946-bdac-2958f76c4bec'] Sep 27 04:26:57.216142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:57Z,description=,direction='egress',ethertype='IPv6',id=e8b29fc1-6b0b-444e-a670-1e5febb7ec7b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b718062f86b14cc7b1ce38b8c46567bd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dcf35fef-f4ac-4946-bdac-2958f76c4bec,updated_at=2022-09-27T04:26:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:57.216495 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e8b29fc1-6b0b-444e-a670-1e5febb7ec7b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.216825 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7c3d0ee3-888c-4ed4-91a5-9a48e0698d4e admin admin] Security group rule updated ['dcf35fef-f4ac-4946-bdac-2958f76c4bec'] Sep 27 04:26:57.349887 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Resource SecurityGroup deleted: dcf35fef-f4ac-4946-bdac-2958f76c4bec {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:57.350299 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (dcf35fef-f4ac-4946-bdac-2958f76c4bec), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.350767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dcf35fef-f4ac-4946-bdac-2958f76c4bec',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:57.364630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dcf35fef-f4ac-4946-bdac-2958f76c4bec',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:57.365096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Resource SecurityGroupRule deleted: 37750641-907e-4341-b7f4-243f4ef1552d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:57.365500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (37750641-907e-4341-b7f4-243f4ef1552d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.365895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Security group rule updated ['dcf35fef-f4ac-4946-bdac-2958f76c4bec'] Sep 27 04:26:57.366282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Resource SecurityGroupRule deleted: 462ff74a-cf15-4811-a652-dd90d51c87ba {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:57.366635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (462ff74a-cf15-4811-a652-dd90d51c87ba), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.366962 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Security group rule updated ['dcf35fef-f4ac-4946-bdac-2958f76c4bec'] Sep 27 04:26:57.367345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Resource SecurityGroupRule deleted: 9b4edf27-5297-42fa-9b47-171a1589e693 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:57.367691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9b4edf27-5297-42fa-9b47-171a1589e693), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.368019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Security group rule updated ['dcf35fef-f4ac-4946-bdac-2958f76c4bec'] Sep 27 04:26:57.368396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Resource SecurityGroupRule deleted: e8b29fc1-6b0b-444e-a670-1e5febb7ec7b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:57.368741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e8b29fc1-6b0b-444e-a670-1e5febb7ec7b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.369064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8a2547aa-e1eb-4733-8087-e66e7579ad03 admin admin] Security group rule updated ['dcf35fef-f4ac-4946-bdac-2958f76c4bec'] Sep 27 04:26:57.718190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:447 started Sep 27 04:26:57.720652 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dd7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=545000000,duration_sec=907,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:57.721234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:57.721592 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:447 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:26:57.736445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:57Z,description='Default security group',id=5613d28a-45a6-454c-b65c-9ae76cf2bb5b,is_default=True,name='default',project_id='c0d1e5a9ecb84d10883a49e351a5ad4f',revision_number=1,rules=[SecurityGroupRule(221d2359-8b99-4e6b-88b0-5b9a23bdcbc8),SecurityGroupRule(b0acc5d7-d617-4dbb-9862-497b0082c057),SecurityGroupRule(b956a63e-a527-4837-b076-6783b83b1ba8),SecurityGroupRule(e2d91ddd-79d9-4f85-8499-242fe22d1310)],shared=False,stateful=True,updated_at=2022-09-27T04:26:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:57.736831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (5613d28a-45a6-454c-b65c-9ae76cf2bb5b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.737459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:57Z,description=,direction='egress',ethertype='IPv4',id=221d2359-8b99-4e6b-88b0-5b9a23bdcbc8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c0d1e5a9ecb84d10883a49e351a5ad4f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5613d28a-45a6-454c-b65c-9ae76cf2bb5b,updated_at=2022-09-27T04:26:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:57.737884 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (221d2359-8b99-4e6b-88b0-5b9a23bdcbc8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.738225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Security group rule updated ['5613d28a-45a6-454c-b65c-9ae76cf2bb5b'] Sep 27 04:26:57.738905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:57Z,description=,direction='ingress',ethertype='IPv6',id=b0acc5d7-d617-4dbb-9862-497b0082c057,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c0d1e5a9ecb84d10883a49e351a5ad4f',protocol=,remote_address_group_id=,remote_group_id=5613d28a-45a6-454c-b65c-9ae76cf2bb5b,remote_ip_prefix=,revision_number=0,security_group_id=5613d28a-45a6-454c-b65c-9ae76cf2bb5b,updated_at=2022-09-27T04:26:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:57.739258 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b0acc5d7-d617-4dbb-9862-497b0082c057), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.739595 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Security group rule updated ['5613d28a-45a6-454c-b65c-9ae76cf2bb5b'] Sep 27 04:26:57.740248 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:57Z,description=,direction='egress',ethertype='IPv6',id=b956a63e-a527-4837-b076-6783b83b1ba8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c0d1e5a9ecb84d10883a49e351a5ad4f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5613d28a-45a6-454c-b65c-9ae76cf2bb5b,updated_at=2022-09-27T04:26:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:57.740605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b956a63e-a527-4837-b076-6783b83b1ba8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.740935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Security group rule updated ['5613d28a-45a6-454c-b65c-9ae76cf2bb5b'] Sep 27 04:26:57.741642 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:57Z,description=,direction='ingress',ethertype='IPv4',id=e2d91ddd-79d9-4f85-8499-242fe22d1310,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c0d1e5a9ecb84d10883a49e351a5ad4f',protocol=,remote_address_group_id=,remote_group_id=5613d28a-45a6-454c-b65c-9ae76cf2bb5b,remote_ip_prefix=,revision_number=0,security_group_id=5613d28a-45a6-454c-b65c-9ae76cf2bb5b,updated_at=2022-09-27T04:26:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:57.742016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e2d91ddd-79d9-4f85-8499-242fe22d1310), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.742349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9a331304-f9e1-487a-ac99-3296f025e666 admin admin] Security group rule updated ['5613d28a-45a6-454c-b65c-9ae76cf2bb5b'] Sep 27 04:26:57.864184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Resource SecurityGroup deleted: 5613d28a-45a6-454c-b65c-9ae76cf2bb5b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:57.864559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (5613d28a-45a6-454c-b65c-9ae76cf2bb5b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.865010 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5613d28a-45a6-454c-b65c-9ae76cf2bb5b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:57.878887 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5613d28a-45a6-454c-b65c-9ae76cf2bb5b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:57.879353 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Resource SecurityGroupRule deleted: 221d2359-8b99-4e6b-88b0-5b9a23bdcbc8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:57.879732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (221d2359-8b99-4e6b-88b0-5b9a23bdcbc8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.880076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Security group rule updated ['5613d28a-45a6-454c-b65c-9ae76cf2bb5b'] Sep 27 04:26:57.880470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Resource SecurityGroupRule deleted: b0acc5d7-d617-4dbb-9862-497b0082c057 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:57.880867 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b0acc5d7-d617-4dbb-9862-497b0082c057), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.881304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Security group rule updated ['5613d28a-45a6-454c-b65c-9ae76cf2bb5b'] Sep 27 04:26:57.881683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Resource SecurityGroupRule deleted: b956a63e-a527-4837-b076-6783b83b1ba8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:57.882076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b956a63e-a527-4837-b076-6783b83b1ba8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.882399 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Security group rule updated ['5613d28a-45a6-454c-b65c-9ae76cf2bb5b'] Sep 27 04:26:57.882770 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Resource SecurityGroupRule deleted: e2d91ddd-79d9-4f85-8499-242fe22d1310 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:57.883146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e2d91ddd-79d9-4f85-8499-242fe22d1310), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:57.883471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-09fcc59f-2092-440e-a7c1-3a18ac43c9e5 admin admin] Security group rule updated ['5613d28a-45a6-454c-b65c-9ae76cf2bb5b'] Sep 27 04:26:59.177383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:26:59Z,description='Default security group',id=6f1dc898-3343-48de-b2c4-36511b1d52da,is_default=True,name='default',project_id='d70fde5da741495e8eb5f199cd42d7a1',revision_number=1,rules=[SecurityGroupRule(3a4157fe-dbf1-45b4-9a6a-b9d147d5b904),SecurityGroupRule(924ee47d-ac2d-4eb4-a46e-916e3ee2181a),SecurityGroupRule(935f6ccb-0ff0-41e3-8aaf-fe47288ba318),SecurityGroupRule(b207b170-7126-4307-b0d1-dd98e598457f)],shared=False,stateful=True,updated_at=2022-09-27T04:26:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:59.178007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (6f1dc898-3343-48de-b2c4-36511b1d52da), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:59.178397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:59Z,description=,direction='ingress',ethertype='IPv4',id=3a4157fe-dbf1-45b4-9a6a-b9d147d5b904,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d70fde5da741495e8eb5f199cd42d7a1',protocol=,remote_address_group_id=,remote_group_id=6f1dc898-3343-48de-b2c4-36511b1d52da,remote_ip_prefix=,revision_number=0,security_group_id=6f1dc898-3343-48de-b2c4-36511b1d52da,updated_at=2022-09-27T04:26:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:59.178755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3a4157fe-dbf1-45b4-9a6a-b9d147d5b904), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:59.179091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Security group rule updated ['6f1dc898-3343-48de-b2c4-36511b1d52da'] Sep 27 04:26:59.179767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:59Z,description=,direction='ingress',ethertype='IPv6',id=924ee47d-ac2d-4eb4-a46e-916e3ee2181a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d70fde5da741495e8eb5f199cd42d7a1',protocol=,remote_address_group_id=,remote_group_id=6f1dc898-3343-48de-b2c4-36511b1d52da,remote_ip_prefix=,revision_number=0,security_group_id=6f1dc898-3343-48de-b2c4-36511b1d52da,updated_at=2022-09-27T04:26:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:59.180118 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (924ee47d-ac2d-4eb4-a46e-916e3ee2181a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:59.180448 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Security group rule updated ['6f1dc898-3343-48de-b2c4-36511b1d52da'] Sep 27 04:26:59.181119 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:59Z,description=,direction='egress',ethertype='IPv4',id=935f6ccb-0ff0-41e3-8aaf-fe47288ba318,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d70fde5da741495e8eb5f199cd42d7a1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6f1dc898-3343-48de-b2c4-36511b1d52da,updated_at=2022-09-27T04:26:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:59.181528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (935f6ccb-0ff0-41e3-8aaf-fe47288ba318), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:59.182054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Security group rule updated ['6f1dc898-3343-48de-b2c4-36511b1d52da'] Sep 27 04:26:59.182739 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:26:59Z,description=,direction='egress',ethertype='IPv6',id=b207b170-7126-4307-b0d1-dd98e598457f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d70fde5da741495e8eb5f199cd42d7a1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6f1dc898-3343-48de-b2c4-36511b1d52da,updated_at=2022-09-27T04:26:59Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:26:59.183111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b207b170-7126-4307-b0d1-dd98e598457f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:59.183387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f70ff31d-f170-4832-9e91-0c768763449e admin admin] Security group rule updated ['6f1dc898-3343-48de-b2c4-36511b1d52da'] Sep 27 04:26:59.315348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Resource SecurityGroup deleted: 6f1dc898-3343-48de-b2c4-36511b1d52da {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:59.315947 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (6f1dc898-3343-48de-b2c4-36511b1d52da), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:59.316704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6f1dc898-3343-48de-b2c4-36511b1d52da',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:26:59.332311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6f1dc898-3343-48de-b2c4-36511b1d52da',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:26:59.332775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Resource SecurityGroupRule deleted: 3a4157fe-dbf1-45b4-9a6a-b9d147d5b904 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:59.333148 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3a4157fe-dbf1-45b4-9a6a-b9d147d5b904), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:59.333487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Security group rule updated ['6f1dc898-3343-48de-b2c4-36511b1d52da'] Sep 27 04:26:59.333906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Resource SecurityGroupRule deleted: 924ee47d-ac2d-4eb4-a46e-916e3ee2181a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:59.334481 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (924ee47d-ac2d-4eb4-a46e-916e3ee2181a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:59.334810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Security group rule updated ['6f1dc898-3343-48de-b2c4-36511b1d52da'] Sep 27 04:26:59.335206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Resource SecurityGroupRule deleted: 935f6ccb-0ff0-41e3-8aaf-fe47288ba318 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:59.335550 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (935f6ccb-0ff0-41e3-8aaf-fe47288ba318), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:59.335896 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Security group rule updated ['6f1dc898-3343-48de-b2c4-36511b1d52da'] Sep 27 04:26:59.336523 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Resource SecurityGroupRule deleted: b207b170-7126-4307-b0d1-dd98e598457f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:26:59.337028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b207b170-7126-4307-b0d1-dd98e598457f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:26:59.337352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c7b7a605-1c79-4e71-999e-e7122181084d admin admin] Security group rule updated ['6f1dc898-3343-48de-b2c4-36511b1d52da'] Sep 27 04:26:59.719160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:448 started Sep 27 04:26:59.721881 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dd9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=546000000,duration_sec=909,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:26:59.722709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:26:59.723074 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:448 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:01.720606 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:449 started Sep 27 04:27:01.723952 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ddb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=548000000,duration_sec=911,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:01.724554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:01.724907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:449 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:02.043263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e4cc911e-11c9-4384-b9c3-a85585982f7e tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource Port deleted: b5c073b9-7000-4407-b92c-8e4279bf0f72 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:02.043649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e4cc911e-11c9-4384-b9c3-a85585982f7e tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (b5c073b9-7000-4407-b92c-8e4279bf0f72), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:02.044181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e4cc911e-11c9-4384-b9c3-a85585982f7e tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group member updated {'4a036648-69d9-4a9d-b723-5993a340c9f4'} Sep 27 04:27:03.721520 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:450 started Sep 27 04:27:03.725769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource SecurityGroup deleted: 4a036648-69d9-4a9d-b723-5993a340c9f4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:03.726166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (4a036648-69d9-4a9d-b723-5993a340c9f4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:03.726632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4a036648-69d9-4a9d-b723-5993a340c9f4',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:27:03.732036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ddd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=550000000,duration_sec=913,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:03.732036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:03.732036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:450 - starting polling. Elapsed:0.010 Sep 27 04:27:03.733135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:03.734530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b5c073b9-7000-4407-b92c-8e4279bf0f72 not present in bridge br-int Sep 27 04:27:03.734867 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:27:03.735156 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['b5c073b9-7000-4407-b92c-8e4279bf0f72'] Sep 27 04:27:03.735479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b5c073b9-7000-4407-b92c-8e4279bf0f72 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:27:03.738050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:450 - port information retrieved. Elapsed:0.017 Sep 27 04:27:03.739101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:450 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 27 04:27:03.741382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4a036648-69d9-4a9d-b723-5993a340c9f4',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:27:03.741862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource SecurityGroupRule deleted: 10e45c5f-f4ef-4199-a94e-98a55cda3d27 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:03.742228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (10e45c5f-f4ef-4199-a94e-98a55cda3d27), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:03.742560 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['4a036648-69d9-4a9d-b723-5993a340c9f4'] Sep 27 04:27:03.742949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource SecurityGroupRule deleted: aa9b8704-91fe-46a7-949a-f821be281894 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:03.743294 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (aa9b8704-91fe-46a7-949a-f821be281894), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:03.743696 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['4a036648-69d9-4a9d-b723-5993a340c9f4'] Sep 27 04:27:03.744077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource SecurityGroupRule deleted: 923a22a9-d84e-422c-9e7c-31115ab5f36e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:03.744421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (923a22a9-d84e-422c-9e7c-31115ab5f36e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:03.744742 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['4a036648-69d9-4a9d-b723-5993a340c9f4'] Sep 27 04:27:03.745115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource SecurityGroupRule deleted: 0f99e0f7-7e02-46b2-8f8e-06db55ce2cd8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:03.745455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0f99e0f7-7e02-46b2-8f8e-06db55ce2cd8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:03.745794 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1031afcd-b193-47bf-9c8a-b05847a24ee3 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Security group rule updated ['4a036648-69d9-4a9d-b723-5993a340c9f4'] Sep 27 04:27:04.119830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-beeb7818-30d5-415b-b993-0851c1d2c622 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Resource Port deleted: 46f78686-8131-4972-b452-475e717d6edf {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:04.120288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-beeb7818-30d5-415b-b993-0851c1d2c622 tempest-AttachVolumeShelveTestJSON-1565737032 tempest-AttachVolumeShelveTestJSON-1565737032-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (46f78686-8131-4972-b452-475e717d6edf), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:05.722765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:451 started Sep 27 04:27:05.725221 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ddf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=549000000,duration_sec=915,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:05.725834 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:05.726179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:451 - starting polling. Elapsed:0.004 Sep 27 04:27:05.728230 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:05.729808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 46f78686-8131-4972-b452-475e717d6edf not present in bridge br-int Sep 27 04:27:05.730149 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:27:05.730440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['46f78686-8131-4972-b452-475e717d6edf'] Sep 27 04:27:05.730768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 46f78686-8131-4972-b452-475e717d6edf is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:27:05.733254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:451 - port information retrieved. Elapsed:0.011 Sep 27 04:27:05.733586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:451 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:27:07.611149 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d858b982-f81a-4d58-a3ff-f423245e0ba8 admin admin] Resource Port deleted: d38ba25f-11e0-4272-a046-108afa9fa96c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:07.611822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d858b982-f81a-4d58-a3ff-f423245e0ba8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (d38ba25f-11e0-4272-a046-108afa9fa96c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:07.723978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:452 started Sep 27 04:27:07.726901 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22de1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=551000000,duration_sec=917,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:07.727517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:07.727886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:452 - starting polling. Elapsed:0.004 Sep 27 04:27:07.730031 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:07.733395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d38ba25f-11, col_values=(('tag', 4095),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:07.741718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22de3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:07.742486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['d38ba25f-11e0-4272-a046-108afa9fa96c'] Sep 27 04:27:07.742796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:27:07.787068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[40577aa9-6894-4e63-850a-2966a4f056dd]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:27:07.790361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:452 - port information retrieved. Elapsed:0.067 Sep 27 04:27:07.790706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:452 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.067 Sep 27 04:27:08.696056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7d111ee0-fb9f-4949-9ed5-7c8adb6f964e","delete","qr-d38ba25f-11",13,["map",[["attached-mac","fa:16:3e:e9:8a:fd"],["iface-id","d38ba25f-11e0-4272-a046-108afa9fa96c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:27:08.879468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-adc97712-8852-4723-b743-97f430ede7d4 admin admin] Resource Port deleted: 72256acd-5a77-4ad3-be5d-043dcec0575b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:08.879850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-adc97712-8852-4723-b743-97f430ede7d4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (72256acd-5a77-4ad3-be5d-043dcec0575b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:09.115973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["95b3bff4-9f0c-42e0-9fc1-8ebc587b2af6","delete","qg-72256acd-5a",14,["map",[["attached-mac","fa:16:3e:2e:dc:79"],["iface-id","72256acd-5a77-4ad3-be5d-043dcec0575b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:27:09.348735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-23146569-75e1-4fb1-b8c6-ac352919267c admin admin] Resource Subnet deleted: 7fbc1344-d37e-4e3c-8ea2-baced031ac4e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:09.349283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-23146569-75e1-4fb1-b8c6-ac352919267c admin admin] Publish callbacks [] for Subnet (7fbc1344-d37e-4e3c-8ea2-baced031ac4e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:09.487500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d2fbb151-4561-491c-8813-c018f5eb45b9","delete","tap133717b2-07",8,["map",[["attached-mac","fa:16:3e:5c:c8:9e"],["iface-id","133717b2-0788-457d-9fba-bcfb1664cf21"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:27:09.681401 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a7e31bd9-8d9e-47b6-8b68-6850d74eacb2 admin admin] Resource Port deleted: 133717b2-0788-457d-9fba-bcfb1664cf21 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:09.682024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a7e31bd9-8d9e-47b6-8b68-6850d74eacb2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (133717b2-0788-457d-9fba-bcfb1664cf21), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:09.724678 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:453 started Sep 27 04:27:09.729210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22de5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=553000000,duration_sec=919,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:09.729478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:09.729966 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:453 - starting polling. Elapsed:0.006 Sep 27 04:27:09.731968 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:09.742290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22de7,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:09.747409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22de9,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:09.752346 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22deb,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:09.753388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:453 - port information retrieved. Elapsed:0.029 Sep 27 04:27:09.754234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': set(), 'removed': {'133717b2-0788-457d-9fba-bcfb1664cf21', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '72256acd-5a77-4ad3-be5d-043dcec0575b'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:27:09.754709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:453 - agent port security group processed in 0.000 Sep 27 04:27:09.756745 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:27:09.757057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'133717b2-0788-457d-9fba-bcfb1664cf21', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '72256acd-5a77-4ad3-be5d-043dcec0575b'} Sep 27 04:27:09.757642 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port d38ba25f-11e0-4272-a046-108afa9fa96c is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:27:09.758215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 8 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:27:09.760832 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5691c83f-576a-4693-b74b-7b032da67bdf None None] Resource Port deleted: 133717b2-0788-457d-9fba-bcfb1664cf21 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:09.761350 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5691c83f-576a-4693-b74b-7b032da67bdf None None] Skipped duplicate delete event for 133717b2-0788-457d-9fba-bcfb1664cf21 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 27 04:27:09.819582 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc959e36-8a21-47ae-be7b-699c8ad74e09]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:27:09.820147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'133717b2-0788-457d-9fba-bcfb1664cf21', 'd38ba25f-11e0-4272-a046-108afa9fa96c', '72256acd-5a77-4ad3-be5d-043dcec0575b'} removed Sep 27 04:27:09.890214 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:27:09.890805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 6 from net-id = 50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6, seg-id = 124 Sep 27 04:27:09.904768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32ebb,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:09.911033 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc22ded,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4220}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:09.911619 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:27:09.912079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:453 - treat_devices_removed completed in 0.155 Sep 27 04:27:09.912473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:453 - ports processed. Elapsed:0.188 Sep 27 04:27:09.913022 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:453 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.188 Sep 27 04:27:09.954253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a7e31bd9-8d9e-47b6-8b68-6850d74eacb2 admin admin] Resource Network deleted: 50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:09.954975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a7e31bd9-8d9e-47b6-8b68-6850d74eacb2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (50cf116a-a1a9-4ea4-9151-a8bbdd56f0e6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:10.247037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Resource SecurityGroup deleted: 131000a9-818e-409d-92c3-5daf5702321e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:10.247684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (131000a9-818e-409d-92c3-5daf5702321e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:10.248615 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('131000a9-818e-409d-92c3-5daf5702321e',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:27:10.264817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('131000a9-818e-409d-92c3-5daf5702321e',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:27:10.265280 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Resource SecurityGroupRule deleted: 172641b8-7dde-411f-9c5c-5d710392128a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:10.265663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (172641b8-7dde-411f-9c5c-5d710392128a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:10.266115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Security group rule updated ['131000a9-818e-409d-92c3-5daf5702321e'] Sep 27 04:27:10.266731 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Resource SecurityGroupRule deleted: 69ee43ac-7da0-4181-8bda-355c7cb19d76 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:10.267717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (69ee43ac-7da0-4181-8bda-355c7cb19d76), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:10.268105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Security group rule updated ['131000a9-818e-409d-92c3-5daf5702321e'] Sep 27 04:27:10.268675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Resource SecurityGroupRule deleted: 83862057-7ebd-436e-a9be-b370a96930df {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:10.269025 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (83862057-7ebd-436e-a9be-b370a96930df), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:10.269358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Security group rule updated ['131000a9-818e-409d-92c3-5daf5702321e'] Sep 27 04:27:10.269900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Resource SecurityGroupRule deleted: 98ad58dc-d428-43bd-9212-cbca1788398d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:10.270426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (98ad58dc-d428-43bd-9212-cbca1788398d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:10.270753 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-35148ec6-421e-4d8e-a322-f28ead8fd827 admin admin] Security group rule updated ['131000a9-818e-409d-92c3-5daf5702321e'] Sep 27 04:27:11.151502 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:27:11Z,description='Default security group',id=c279fa26-f34d-4447-83b5-945b6c520f46,is_default=True,name='default',project_id='d7c74ffec54740eca3cd6b707f1cb732',revision_number=1,rules=[SecurityGroupRule(18f2a32c-72c3-41d4-a336-96f5702dd4e1),SecurityGroupRule(781e6a96-9aea-45dd-a6f9-05c87ae858fd),SecurityGroupRule(95eed30f-7c03-44f4-8c8c-f03f78e1f11c),SecurityGroupRule(b9ad98d7-fdb9-4466-99b0-6924858a5dba)],shared=False,stateful=True,updated_at=2022-09-27T04:27:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:11.152150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (c279fa26-f34d-4447-83b5-945b6c520f46), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:11.152488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:11Z,description=,direction='egress',ethertype='IPv4',id=18f2a32c-72c3-41d4-a336-96f5702dd4e1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c279fa26-f34d-4447-83b5-945b6c520f46,updated_at=2022-09-27T04:27:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:11.152868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (18f2a32c-72c3-41d4-a336-96f5702dd4e1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:11.153205 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Security group rule updated ['c279fa26-f34d-4447-83b5-945b6c520f46'] Sep 27 04:27:11.153919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:11Z,description=,direction='egress',ethertype='IPv6',id=781e6a96-9aea-45dd-a6f9-05c87ae858fd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c279fa26-f34d-4447-83b5-945b6c520f46,updated_at=2022-09-27T04:27:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:11.154273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (781e6a96-9aea-45dd-a6f9-05c87ae858fd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:11.154600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Security group rule updated ['c279fa26-f34d-4447-83b5-945b6c520f46'] Sep 27 04:27:11.155250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:11Z,description=,direction='ingress',ethertype='IPv4',id=95eed30f-7c03-44f4-8c8c-f03f78e1f11c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=c279fa26-f34d-4447-83b5-945b6c520f46,remote_ip_prefix=,revision_number=0,security_group_id=c279fa26-f34d-4447-83b5-945b6c520f46,updated_at=2022-09-27T04:27:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:11.155599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (95eed30f-7c03-44f4-8c8c-f03f78e1f11c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:11.155924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Security group rule updated ['c279fa26-f34d-4447-83b5-945b6c520f46'] Sep 27 04:27:11.156569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:11Z,description=,direction='ingress',ethertype='IPv6',id=b9ad98d7-fdb9-4466-99b0-6924858a5dba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=c279fa26-f34d-4447-83b5-945b6c520f46,remote_ip_prefix=,revision_number=0,security_group_id=c279fa26-f34d-4447-83b5-945b6c520f46,updated_at=2022-09-27T04:27:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:11.156917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b9ad98d7-fdb9-4466-99b0-6924858a5dba), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:11.157239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Security group rule updated ['c279fa26-f34d-4447-83b5-945b6c520f46'] Sep 27 04:27:11.288682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:27:11Z,description='',dns_domain=None,id=cba0fe06-d029-4450-9dfd-fb0123caa50b,mtu=1500,name='tempest-AttachVolumeNegativeTest-148283676-network',project_id='d7c74ffec54740eca3cd6b707f1cb732',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(cba0fe06-d029-4450-9dfd-fb0123caa50b),segments=[NetworkSegment(c5746d98-25dd-46c1-b1b6-0887fcb5090c)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:27:11Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:11.289082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (cba0fe06-d029-4450-9dfd-fb0123caa50b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-60652b65-336c-4347-b2e4-1ae92c1cb793 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network cba0fe06-d029-4450-9dfd-fb0123caa50b with segmentation id not found. Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:27:11.365673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:27:11.366669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:27:11.366669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:27:11.366669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:27:11.366669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network cba0fe06-d029-4450-9dfd-fb0123caa50b with segmentation id not found. Sep 27 04:27:11.366669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:27:11.569600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-96946338-21ab-4e02-a583-733f47afa581 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(f52e3cb5-7958-408a-8d5d-ac92168b0d64)],cidr=172.20.0.0/28,created_at=2022-09-27T04:27:11Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=d4d9fbf8-be25-413e-9d9a-4acede1bc3df,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeNegativeTest-148283676-subnet',network_id=cba0fe06-d029-4450-9dfd-fb0123caa50b,project_id='d7c74ffec54740eca3cd6b707f1cb732',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:27:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:11.570024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-96946338-21ab-4e02-a583-733f47afa581 admin admin] Publish callbacks [] for Subnet (d4d9fbf8-be25-413e-9d9a-4acede1bc3df), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:11.725465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:454 started Sep 27 04:27:11.885332 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22def,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=552000000,duration_sec=921,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:11.887445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:11.887807 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:454 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.163 Sep 27 04:27:12.076924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-17f0f3b3-b6a5-4d40-b8b2-41a63a982b91 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:27:11Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-cba0fe06-d029-4450-9dfd-fb0123caa50b',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4fb3a760-0b2e-4b6c-b229-ad4e9b60031e,mac_address=fa:16:3e:32:0d:4e,name='',network_id=cba0fe06-d029-4450-9dfd-fb0123caa50b,numa_affinity_policy=,project_id='d7c74ffec54740eca3cd6b707f1cb732',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4fb3a760-0b2e-4b6c-b229-ad4e9b60031e),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:27:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:12.077545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-17f0f3b3-b6a5-4d40-b8b2-41a63a982b91 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (4fb3a760-0b2e-4b6c-b229-ad4e9b60031e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:12.417537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a6c591db-15e3-4127-9a5f-c8dff1124aaf admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:27:12Z,data_plane_status=None,description='',device_id='4c6af9de-cc1b-48df-9bb1-e87847c76f9f',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=df24a64e-a855-4c93-9fc9-4c4a85f449c2,mac_address=fa:16:3e:61:98:65,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(df24a64e-a855-4c93-9fc9-4c4a85f449c2),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:27:12Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:12.418692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a6c591db-15e3-4127-9a5f-c8dff1124aaf admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (df24a64e-a855-4c93-9fc9-4c4a85f449c2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:12.457635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-17f0f3b3-b6a5-4d40-b8b2-41a63a982b91 None None] Resource Port 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=4fb3a760-0b2e-4b6c-b229-ad4e9b60031e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=4fb3a760-0b2e-4b6c-b229-ad4e9b60031e,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=4fb3a760-0b2e-4b6c-b229-ad4e9b60031e,segment=NetworkSegment(c5746d98-25dd-46c1-b1b6-0887fcb5090c),segment_id=c5746d98-25dd-46c1-b1b6-0887fcb5090c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:12.463017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-17f0f3b3-b6a5-4d40-b8b2-41a63a982b91 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (4fb3a760-0b2e-4b6c-b229-ad4e9b60031e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:12.556730 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["59ed49f2-d5b6-4f21-993a-f1ef7fd19086","insert","tap4fb3a760-0b",["set",[]],["map",[["attached-mac","fa:16:3e:32:0d:4e"],["iface-id","4fb3a760-0b2e-4b6c-b229-ad4e9b60031e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:27:12.572145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["59ed49f2-d5b6-4f21-993a-f1ef7fd19086","old",null,["set",[]],null],["","new","tap4fb3a760-0b",30,["map",[["attached-mac","fa:16:3e:32:0d:4e"],["iface-id","4fb3a760-0b2e-4b6c-b229-ad4e9b60031e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:27:13.726778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:455 started Sep 27 04:27:13.732854 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22df1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=553000000,duration_sec=923,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:13.733457 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:13.734599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:455 - starting polling. Elapsed:0.007 Sep 27 04:27:13.737142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:13.739791 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:455 - port information retrieved. Elapsed:0.013 Sep 27 04:27:13.740320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9'}, 'added': {'4fb3a760-0b2e-4b6c-b229-ad4e9b60031e'}, 'removed': set(), 'updated': {'4fb3a760-0b2e-4b6c-b229-ad4e9b60031e'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:27:13.741255 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-cba0fe06-d029-4450-9dfd-fb0123caa50b', 'network_id': 'cba0fe06-d029-4450-9dfd-fb0123caa50b', 'port_id': '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', 'mac_address': 'fa:16:3e:32:0d:4e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d9fbf8-be25-413e-9d9a-4acede1bc3df', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:27:13.743690 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:27:13.744558 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e updated. Details: {'device': '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-cba0fe06-d029-4450-9dfd-fb0123caa50b', 'network_id': 'cba0fe06-d029-4450-9dfd-fb0123caa50b', 'port_id': '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', 'mac_address': 'fa:16:3e:32:0d:4e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d9fbf8-be25-413e-9d9a-4acede1bc3df', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:27:13.745093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 12 as local vlan for net-id=cba0fe06-d029-4450-9dfd-fb0123caa50b, seg-id=112 Sep 27 04:27:13.749551 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32ebd,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4208), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:13.754003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22df3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4108)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4208}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:13.755759 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4fb3a760-0b, col_values=(('tag', 12),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:13.756261 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap4fb3a760-0b, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:13.756734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap4fb3a760-0b, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:13.773298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4fb3a760-0b, col_values=(('other_config', {'net_uuid': 'cba0fe06-d029-4450-9dfd-fb0123caa50b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '112'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:13.789425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22df5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:13.790609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:455 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 11 devices currently available. Time elapsed: 0.050 Sep 27 04:27:13.791493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:27:13.791974 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'4fb3a760-0b2e-4b6c-b229-ad4e9b60031e'} Sep 27 04:27:13.793318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:27:13.793991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:27:13.797445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:27:13.855231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afeb688-f5e9-4252-b23d-4874fd2b874c]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:27:13.855925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:455 - agent port security group processed in 0.115 Sep 27 04:27:13.856698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:27:14.048177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-11160290-793e-4e35-9431-f07aa2e93831 None None] Resource Port 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:14.048573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-11160290-793e-4e35-9431-f07aa2e93831 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (4fb3a760-0b2e-4b6c-b229-ad4e9b60031e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:14.177598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-54c7fbaf-c3f8-43fd-8037-9b5860e4620c admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:27:13Z,data_plane_status=None,description='',device_id='4c6af9de-cc1b-48df-9bb1-e87847c76f9f',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a232fa3d-5135-4b2b-beba-1695e497a1d7,mac_address=fa:16:3e:40:05:11,name='',network_id=cba0fe06-d029-4450-9dfd-fb0123caa50b,numa_affinity_policy=,project_id='d7c74ffec54740eca3cd6b707f1cb732',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a232fa3d-5135-4b2b-beba-1695e497a1d7),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:27:13Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:14.178133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-54c7fbaf-c3f8-43fd-8037-9b5860e4620c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a232fa3d-5135-4b2b-beba-1695e497a1d7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:14.319421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['4fb3a760-0b2e-4b6c-b229-ad4e9b60031e'] and devices down [] completed. Sep 27 04:27:14.320001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:455 - ports processed. Elapsed:0.593 Sep 27 04:27:14.320388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:455 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.594 Sep 27 04:27:14.536442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d7b2988e-b3b7-4fee-b548-4226749a80ac None None] Resource Port df24a64e-a855-4c93-9fc9-4c4a85f449c2 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=df24a64e-a855-4c93-9fc9-4c4a85f449c2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=df24a64e-a855-4c93-9fc9-4c4a85f449c2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:14.536637 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d7b2988e-b3b7-4fee-b548-4226749a80ac None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (df24a64e-a855-4c93-9fc9-4c4a85f449c2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:14.579296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-54c7fbaf-c3f8-43fd-8037-9b5860e4620c admin admin] Received resource Port update without any changes: a232fa3d-5135-4b2b-beba-1695e497a1d7 {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:27:14.732532 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d7b2988e-b3b7-4fee-b548-4226749a80ac None None] Resource Port df24a64e-a855-4c93-9fc9-4c4a85f449c2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=df24a64e-a855-4c93-9fc9-4c4a85f449c2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=df24a64e-a855-4c93-9fc9-4c4a85f449c2,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=df24a64e-a855-4c93-9fc9-4c4a85f449c2,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:14.734403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d7b2988e-b3b7-4fee-b548-4226749a80ac None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (df24a64e-a855-4c93-9fc9-4c4a85f449c2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:15.342575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["024e55ab-b6e8-4327-bfb6-f844aec22374","insert","qr-a232fa3d-51",["set",[]],["map",[["attached-mac","fa:16:3e:40:05:11"],["iface-id","a232fa3d-5135-4b2b-beba-1695e497a1d7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:27:15.361303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["024e55ab-b6e8-4327-bfb6-f844aec22374","old",null,["set",[]],null],["","new","qr-a232fa3d-51",31,["map",[["attached-mac","fa:16:3e:40:05:11"],["iface-id","a232fa3d-5135-4b2b-beba-1695e497a1d7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:27:15.372275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6df57817-05a2-4cbc-b6f8-0404a5518897 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:27:15Z,description='tempest-description--803347472',id=faa72a12-bdbd-4886-bc21-c1494225c046,is_default=False,name='tempest-securitygroup--1406019748',project_id='d7c74ffec54740eca3cd6b707f1cb732',revision_number=1,rules=[SecurityGroupRule(7f60767d-ee5d-4633-9484-31ea6b54793c),SecurityGroupRule(92d9cebc-01d7-4c42-af5e-ba0af500399e)],shared=False,stateful=True,updated_at=2022-09-27T04:27:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:15.373143 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6df57817-05a2-4cbc-b6f8-0404a5518897 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (faa72a12-bdbd-4886-bc21-c1494225c046), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:15.374028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6df57817-05a2-4cbc-b6f8-0404a5518897 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:15Z,description=,direction='egress',ethertype='IPv6',id=7f60767d-ee5d-4633-9484-31ea6b54793c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=faa72a12-bdbd-4886-bc21-c1494225c046,updated_at=2022-09-27T04:27:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:15.374685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6df57817-05a2-4cbc-b6f8-0404a5518897 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7f60767d-ee5d-4633-9484-31ea6b54793c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:15.375302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6df57817-05a2-4cbc-b6f8-0404a5518897 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['faa72a12-bdbd-4886-bc21-c1494225c046'] Sep 27 04:27:15.376443 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6df57817-05a2-4cbc-b6f8-0404a5518897 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:15Z,description=,direction='egress',ethertype='IPv4',id=92d9cebc-01d7-4c42-af5e-ba0af500399e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=faa72a12-bdbd-4886-bc21-c1494225c046,updated_at=2022-09-27T04:27:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:15.377060 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6df57817-05a2-4cbc-b6f8-0404a5518897 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (92d9cebc-01d7-4c42-af5e-ba0af500399e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:15.378493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6df57817-05a2-4cbc-b6f8-0404a5518897 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['faa72a12-bdbd-4886-bc21-c1494225c046'] Sep 27 04:27:15.492801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c34e3452-773c-4ec5-9dab-eb792a145b2a tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:15Z,description='',direction='ingress',ethertype='IPv4',id=c4b58927-5b09-48af-8037-f493ac37afde,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=faa72a12-bdbd-4886-bc21-c1494225c046,updated_at=2022-09-27T04:27:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:15.493321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c34e3452-773c-4ec5-9dab-eb792a145b2a tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c4b58927-5b09-48af-8037-f493ac37afde), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:15.493772 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c34e3452-773c-4ec5-9dab-eb792a145b2a tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['faa72a12-bdbd-4886-bc21-c1494225c046'] Sep 27 04:27:15.634492 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bb0dfbb9-0adc-47c7-b15b-63523d39f836 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:15Z,description='',direction='ingress',ethertype='IPv4',id=3907d43f-37d7-4298-aaeb-bca798d96e2f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=faa72a12-bdbd-4886-bc21-c1494225c046,updated_at=2022-09-27T04:27:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:15.636615 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bb0dfbb9-0adc-47c7-b15b-63523d39f836 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3907d43f-37d7-4298-aaeb-bca798d96e2f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:15.636804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bb0dfbb9-0adc-47c7-b15b-63523d39f836 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['faa72a12-bdbd-4886-bc21-c1494225c046'] Sep 27 04:27:15.727424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:456 started Sep 27 04:27:15.730039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22df7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=554000000,duration_sec=925,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:15.730906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:15.731577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:456 - starting polling. Elapsed:0.004 Sep 27 04:27:15.733859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:15.737387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:456 - port information retrieved. Elapsed:0.010 Sep 27 04:27:15.737986 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': {'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'removed': set(), 'updated': {'4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:27:15.738481 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-cba0fe06-d029-4450-9dfd-fb0123caa50b', 'network_id': 'cba0fe06-d029-4450-9dfd-fb0123caa50b', 'port_id': '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', 'mac_address': 'fa:16:3e:32:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d9fbf8-be25-413e-9d9a-4acede1bc3df', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:27:15.747037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:27:13Z,data_plane_status=None,description='',device_id='4c6af9de-cc1b-48df-9bb1-e87847c76f9f',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a232fa3d-5135-4b2b-beba-1695e497a1d7,mac_address=fa:16:3e:40:05:11,name='',network_id=cba0fe06-d029-4450-9dfd-fb0123caa50b,numa_affinity_policy=,project_id='d7c74ffec54740eca3cd6b707f1cb732',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(a232fa3d-5135-4b2b-beba-1695e497a1d7),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:27:14Z) is not bound. Sep 27 04:27:15.750111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:27:15.750447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e updated. Details: {'device': '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-cba0fe06-d029-4450-9dfd-fb0123caa50b', 'network_id': 'cba0fe06-d029-4450-9dfd-fb0123caa50b', 'port_id': '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', 'mac_address': 'fa:16:3e:32:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d9fbf8-be25-413e-9d9a-4acede1bc3df', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Sep 27 04:27:15.751487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4fb3a760-0b, col_values=(('tag', 12),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:15.752630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap4fb3a760-0b, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:15.753175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap4fb3a760-0b, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:15.755980 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:27:15.757017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4fb3a760-0b, col_values=(('other_config', {'net_uuid': 'cba0fe06-d029-4450-9dfd-fb0123caa50b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '112', 'tag': '12'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:15.757892 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:27:15.764461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22df9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:15.765104 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: a232fa3d-5135-4b2b-beba-1695e497a1d7 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:27:15.765472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device a232fa3d-5135-4b2b-beba-1695e497a1d7 not defined on plugin or binding failed Sep 27 04:27:15.766121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:456 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.028 Sep 27 04:27:15.766532 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:27:15.766922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'a232fa3d-5135-4b2b-beba-1695e497a1d7'} Sep 27 04:27:15.769877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:27:15.770427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:27:15.774848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:27:15.775099 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:27:15.776250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:27:15.776447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:27:15.780031 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:27:15.813725 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3efe49e5-2581-459d-b9db-2fbcfe7b5402","insert","qg-df24a64e-a8",["set",[]],["map",[["attached-mac","fa:16:3e:61:98:65"],["iface-id","df24a64e-a855-4c93-9fc9-4c4a85f449c2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:27:15.831720 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3efe49e5-2581-459d-b9db-2fbcfe7b5402","old",null,["set",[]],null],["","new","qg-df24a64e-a8",32,["map",[["attached-mac","fa:16:3e:61:98:65"],["iface-id","df24a64e-a855-4c93-9fc9-4c4a85f449c2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:27:15.860447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a3b20d-b968-4ad0-8436-725e3e27e607]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:27:15.861167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:456 - agent port security group processed in 0.123 Sep 27 04:27:15.862190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:27:16.038212 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['4fb3a760-0b2e-4b6c-b229-ad4e9b60031e'] and devices down [] completed. Sep 27 04:27:16.038889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:456 - ports processed. Elapsed:0.312 Sep 27 04:27:16.039452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:456 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.312 Sep 27 04:27:16.199877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5e6ae56f-6310-4762-9b14-2702cc2c980f tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:27:15Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d455b83d-5534-45ca-8572-246bb2fd7a89,mac_address=fa:16:3e:4c:4f:7a,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d455b83d-5534-45ca-8572-246bb2fd7a89),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:27:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:16.201697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5e6ae56f-6310-4762-9b14-2702cc2c980f tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (d455b83d-5534-45ca-8572-246bb2fd7a89), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:16.546114 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5e6ae56f-6310-4762-9b14-2702cc2c980f tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port d455b83d-5534-45ca-8572-246bb2fd7a89 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '0a29b6c4-f54c-4b7d-a466-9d0847c258c9'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:16.546516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5e6ae56f-6310-4762-9b14-2702cc2c980f tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (d455b83d-5534-45ca-8572-246bb2fd7a89), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:17.728847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:457 started Sep 27 04:27:17.732375 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dfb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=556000000,duration_sec=927,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:17.732959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:17.733620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:457 - starting polling. Elapsed:0.005 Sep 27 04:27:17.735786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:17.739024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:457 - port information retrieved. Elapsed:0.010 Sep 27 04:27:17.739356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': {'df24a64e-a855-4c93-9fc9-4c4a85f449c2'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:27:17.739945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'device_id': '4c6af9de-cc1b-48df-9bb1-e87847c76f9f', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'mac_address': 'fa:16:3e:61:98:65', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.128'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:27:17.742619 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: df24a64e-a855-4c93-9fc9-4c4a85f449c2 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:27:17.742944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port df24a64e-a855-4c93-9fc9-4c4a85f449c2 updated. Details: {'device': 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'device_id': '4c6af9de-cc1b-48df-9bb1-e87847c76f9f', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'mac_address': 'fa:16:3e:61:98:65', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.128'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:27:17.744032 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-df24a64e-a8, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:17.744460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-df24a64e-a8, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:17.744891 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-df24a64e-a8, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:17.753913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-df24a64e-a8, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:17.763646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22dfd,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:17.764003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:457 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.024 Sep 27 04:27:17.764358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:27:17.764662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'df24a64e-a855-4c93-9fc9-4c4a85f449c2'} Sep 27 04:27:17.766009 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:27:17.766208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:27:17.769502 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:27:17.823958 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0995fd6e-8a73-41d3-9ad2-f5d5f04fe314]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:27:17.824597 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:457 - agent port security group processed in 0.085 Sep 27 04:27:17.825536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for df24a64e-a855-4c93-9fc9-4c4a85f449c2 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:27:17.994769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['df24a64e-a855-4c93-9fc9-4c4a85f449c2'] and devices down [] completed. Sep 27 04:27:17.995486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:457 - ports processed. Elapsed:0.267 Sep 27 04:27:17.996157 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:457 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.267 Sep 27 04:27:18.020961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-171f64b9-2d1a-457d-b7cb-e9a52c0012f2 None None] Resource Port a232fa3d-5135-4b2b-beba-1695e497a1d7 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=a232fa3d-5135-4b2b-beba-1695e497a1d7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=a232fa3d-5135-4b2b-beba-1695e497a1d7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:18.021452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-171f64b9-2d1a-457d-b7cb-e9a52c0012f2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a232fa3d-5135-4b2b-beba-1695e497a1d7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:18.048664 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port df24a64e-a855-4c93-9fc9-4c4a85f449c2 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=df24a64e-a855-4c93-9fc9-4c4a85f449c2,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=df24a64e-a855-4c93-9fc9-4c4a85f449c2,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:18.049598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (df24a64e-a855-4c93-9fc9-4c4a85f449c2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:18.256195 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-171f64b9-2d1a-457d-b7cb-e9a52c0012f2 None None] Resource Port a232fa3d-5135-4b2b-beba-1695e497a1d7 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=a232fa3d-5135-4b2b-beba-1695e497a1d7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=a232fa3d-5135-4b2b-beba-1695e497a1d7,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=a232fa3d-5135-4b2b-beba-1695e497a1d7,segment=NetworkSegment(c5746d98-25dd-46c1-b1b6-0887fcb5090c),segment_id=c5746d98-25dd-46c1-b1b6-0887fcb5090c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:18.256582 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-171f64b9-2d1a-457d-b7cb-e9a52c0012f2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a232fa3d-5135-4b2b-beba-1695e497a1d7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:18.510966 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-71fba42a-2daf-4f61-a3c1-b942d98667e6 None None] Resource Port a232fa3d-5135-4b2b-beba-1695e497a1d7 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:18.511352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-71fba42a-2daf-4f61-a3c1-b942d98667e6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (a232fa3d-5135-4b2b-beba-1695e497a1d7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:19.729850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:458 started Sep 27 04:27:19.732334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22dff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=556000000,duration_sec=929,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:19.732922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:19.733272 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:458 - starting polling. Elapsed:0.004 Sep 27 04:27:19.735349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:19.737920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:458 - port information retrieved. Elapsed:0.008 Sep 27 04:27:19.738267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'e4db657b-a959-4e62-b211-2cb063d743eb', 'fe4ecad8-9126-45df-830c-fb2391ce585d', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': set(), 'removed': set(), 'updated': {'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:27:19.738859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'device_id': '4c6af9de-cc1b-48df-9bb1-e87847c76f9f', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'mac_address': 'fa:16:3e:61:98:65', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.128'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:27:19.739330 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'a232fa3d-5135-4b2b-beba-1695e497a1d7', 'device_id': '4c6af9de-cc1b-48df-9bb1-e87847c76f9f', 'network_id': 'cba0fe06-d029-4450-9dfd-fb0123caa50b', 'port_id': 'a232fa3d-5135-4b2b-beba-1695e497a1d7', 'mac_address': 'fa:16:3e:40:05:11', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d9fbf8-be25-413e-9d9a-4acede1bc3df', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:27:19.741820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: df24a64e-a855-4c93-9fc9-4c4a85f449c2 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:27:19.742154 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port df24a64e-a855-4c93-9fc9-4c4a85f449c2 updated. Details: {'device': 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'device_id': '4c6af9de-cc1b-48df-9bb1-e87847c76f9f', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'mac_address': 'fa:16:3e:61:98:65', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.128'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:27:19.743148 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-df24a64e-a8, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:19.743579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-df24a64e-a8, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:19.743981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-df24a64e-a8, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:19.744433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:27:19.745186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-df24a64e-a8, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:19.745847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:27:19.747984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e01,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:19.748323 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: a232fa3d-5135-4b2b-beba-1695e497a1d7 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:27:19.748651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port a232fa3d-5135-4b2b-beba-1695e497a1d7 updated. Details: {'device': 'a232fa3d-5135-4b2b-beba-1695e497a1d7', 'device_id': '4c6af9de-cc1b-48df-9bb1-e87847c76f9f', 'network_id': 'cba0fe06-d029-4450-9dfd-fb0123caa50b', 'port_id': 'a232fa3d-5135-4b2b-beba-1695e497a1d7', 'mac_address': 'fa:16:3e:40:05:11', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d9fbf8-be25-413e-9d9a-4acede1bc3df', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Sep 27 04:27:19.749513 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a232fa3d-51, col_values=(('tag', 12),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:19.750013 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-a232fa3d-51, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:19.750558 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-a232fa3d-51, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:19.754567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a232fa3d-51, col_values=(('other_config', {'net_uuid': 'cba0fe06-d029-4450-9dfd-fb0123caa50b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '112'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:27:19.762253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e03,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:19.762598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:458 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.024 Sep 27 04:27:19.763778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 2 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:27:19.764106 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:27:19.766640 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:27:19.766932 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:27:19.771479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:27:19.809910 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed50975-674c-4bdb-af17-c8a3cd187f62]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:27:19.810701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:458 - agent port security group processed in 0.072 Sep 27 04:27:19.811606 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for df24a64e-a855-4c93-9fc9-4c4a85f449c2 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:27:19.811998 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for a232fa3d-5135-4b2b-beba-1695e497a1d7 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:27:20.037407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bd33e981-b4cc-4d4b-8a3a-165ea05b8c2d tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:27:19Z,data_plane_status=None,description='',device_id='93c1b78a-1f68-4d8b-a00a-15ed4dfe4779',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=59621d87-e6fa-445c-98d8-2f933c046f0d,mac_address=fa:16:3e:81:f2:25,name='',network_id=cba0fe06-d029-4450-9dfd-fb0123caa50b,numa_affinity_policy=,project_id='d7c74ffec54740eca3cd6b707f1cb732',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(59621d87-e6fa-445c-98d8-2f933c046f0d),security_group_ids=set([faa72a12-bdbd-4886-bc21-c1494225c046]),status='DOWN',updated_at=2022-09-27T04:27:19Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:20.038936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bd33e981-b4cc-4d4b-8a3a-165ea05b8c2d tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (59621d87-e6fa-445c-98d8-2f933c046f0d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:20.039484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bd33e981-b4cc-4d4b-8a3a-165ea05b8c2d tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group member updated {'faa72a12-bdbd-4886-bc21-c1494225c046'} Sep 27 04:27:20.071070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'] and devices down [] completed. Sep 27 04:27:20.071456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:458 - ports processed. Elapsed:0.342 Sep 27 04:27:20.071906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:458 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.342 Sep 27 04:27:20.509996 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6e7ad5d2-272c-4f0b-bd04-7d130fb6c617 service neutron] Resource Port 59621d87-e6fa-445c-98d8-2f933c046f0d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=59621d87-e6fa-445c-98d8-2f933c046f0d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=59621d87-e6fa-445c-98d8-2f933c046f0d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:20.510650 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6e7ad5d2-272c-4f0b-bd04-7d130fb6c617 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (59621d87-e6fa-445c-98d8-2f933c046f0d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:20.944855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6e7ad5d2-272c-4f0b-bd04-7d130fb6c617 service neutron] Resource Port 59621d87-e6fa-445c-98d8-2f933c046f0d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=59621d87-e6fa-445c-98d8-2f933c046f0d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=59621d87-e6fa-445c-98d8-2f933c046f0d,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=59621d87-e6fa-445c-98d8-2f933c046f0d,segment=NetworkSegment(c5746d98-25dd-46c1-b1b6-0887fcb5090c),segment_id=c5746d98-25dd-46c1-b1b6-0887fcb5090c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:20.945449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6e7ad5d2-272c-4f0b-bd04-7d130fb6c617 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (59621d87-e6fa-445c-98d8-2f933c046f0d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:21.731175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:459 started Sep 27 04:27:21.736801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e05,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=558000000,duration_sec=931,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:21.737384 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:21.737726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:459 - starting polling. Elapsed:0.007 Sep 27 04:27:21.739792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:21.742330 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:459 - port information retrieved. Elapsed:0.011 Sep 27 04:27:21.742667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:459 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:27:23.732380 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:460 started Sep 27 04:27:23.734824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e07,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=559000000,duration_sec=933,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:23.735475 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:23.735768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:460 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:23.973364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 59621d87-e6fa-445c-98d8-2f933c046f0d updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:23.973773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (59621d87-e6fa-445c-98d8-2f933c046f0d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:25.733052 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:461 started Sep 27 04:27:25.735506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e09,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=560000000,duration_sec=935,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:25.736077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:25.736412 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:461 - starting polling. Elapsed:0.004 Sep 27 04:27:25.738466 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:25.741019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:461 - port information retrieved. Elapsed:0.008 Sep 27 04:27:25.741351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:461 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:27:26.913400 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 59621d87-e6fa-445c-98d8-2f933c046f0d updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:26.914034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (59621d87-e6fa-445c-98d8-2f933c046f0d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:27.734018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:462 started Sep 27 04:27:27.737366 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e0b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=561000000,duration_sec=937,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:27.738051 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:27.738469 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:462 - starting polling. Elapsed:0.005 Sep 27 04:27:27.740507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:27.743174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:462 - port information retrieved. Elapsed:0.009 Sep 27 04:27:27.743508 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:462 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:27:29.734658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:463 started Sep 27 04:27:29.737912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e0d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=561000000,duration_sec=939,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:29.738489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:29.738842 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:463 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:31.420675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:27:31Z,description='Default security group',id=dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd,is_default=True,name='default',project_id='ae2f2bea79ab48c5bd28339fdac86fb3',revision_number=1,rules=[SecurityGroupRule(15f9abd0-f327-4a93-a5a8-1b660df2dd80),SecurityGroupRule(59f7d14f-9c75-4798-af34-28014bf79f71),SecurityGroupRule(8b332496-65b2-4af8-a51c-1da051f47d08),SecurityGroupRule(cd905f24-6397-441f-bb9e-f1ce3234555d)],shared=False,stateful=True,updated_at=2022-09-27T04:27:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:31.422339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:31.423824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:31Z,description=,direction='egress',ethertype='IPv4',id=15f9abd0-f327-4a93-a5a8-1b660df2dd80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ae2f2bea79ab48c5bd28339fdac86fb3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd,updated_at=2022-09-27T04:27:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:31.425017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (15f9abd0-f327-4a93-a5a8-1b660df2dd80), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:31.425517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Security group rule updated ['dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd'] Sep 27 04:27:31.426602 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:31Z,description=,direction='egress',ethertype='IPv6',id=59f7d14f-9c75-4798-af34-28014bf79f71,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ae2f2bea79ab48c5bd28339fdac86fb3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd,updated_at=2022-09-27T04:27:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:31.427695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (59f7d14f-9c75-4798-af34-28014bf79f71), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:31.428195 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Security group rule updated ['dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd'] Sep 27 04:27:31.429017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:31Z,description=,direction='ingress',ethertype='IPv6',id=8b332496-65b2-4af8-a51c-1da051f47d08,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ae2f2bea79ab48c5bd28339fdac86fb3',protocol=,remote_address_group_id=,remote_group_id=dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd,remote_ip_prefix=,revision_number=0,security_group_id=dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd,updated_at=2022-09-27T04:27:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:31.429764 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8b332496-65b2-4af8-a51c-1da051f47d08), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:31.430268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Security group rule updated ['dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd'] Sep 27 04:27:31.431617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:31Z,description=,direction='ingress',ethertype='IPv4',id=cd905f24-6397-441f-bb9e-f1ce3234555d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ae2f2bea79ab48c5bd28339fdac86fb3',protocol=,remote_address_group_id=,remote_group_id=dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd,remote_ip_prefix=,revision_number=0,security_group_id=dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd,updated_at=2022-09-27T04:27:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:31.432144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cd905f24-6397-441f-bb9e-f1ce3234555d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:31.432633 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c2eba1f-203a-482e-841b-e3def365fcde admin admin] Security group rule updated ['dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd'] Sep 27 04:27:31.547077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Resource SecurityGroup deleted: dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:31.547651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:31.548311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:27:31.564229 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:27:31.564850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Resource SecurityGroupRule deleted: 15f9abd0-f327-4a93-a5a8-1b660df2dd80 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:31.565521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (15f9abd0-f327-4a93-a5a8-1b660df2dd80), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:31.566115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Security group rule updated ['dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd'] Sep 27 04:27:31.566620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Resource SecurityGroupRule deleted: 59f7d14f-9c75-4798-af34-28014bf79f71 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:31.567076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (59f7d14f-9c75-4798-af34-28014bf79f71), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:31.568004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Security group rule updated ['dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd'] Sep 27 04:27:31.568702 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Resource SecurityGroupRule deleted: 8b332496-65b2-4af8-a51c-1da051f47d08 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:31.569529 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (8b332496-65b2-4af8-a51c-1da051f47d08), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:31.569981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Security group rule updated ['dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd'] Sep 27 04:27:31.570540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Resource SecurityGroupRule deleted: cd905f24-6397-441f-bb9e-f1ce3234555d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:31.570888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cd905f24-6397-441f-bb9e-f1ce3234555d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:31.571298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-305d2d66-149f-453e-a059-281aaf133852 admin admin] Security group rule updated ['dabc8eaa-396d-40fc-a0b8-1e0c1619c1cd'] Sep 27 04:27:31.735667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:464 started Sep 27 04:27:31.739658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e0f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=563000000,duration_sec=941,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:31.741203 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:31.742064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:464 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:27:32.005270 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:27:31Z,description='Default security group',id=ae58b0cf-9e83-420e-ac2f-ff9e704f9359,is_default=True,name='default',project_id='7614a1b21d144efeb90a6e7ced0b9ed0',revision_number=1,rules=[SecurityGroupRule(21ed1334-9051-44ca-82bc-311773568636),SecurityGroupRule(a1fb5981-7abd-4c16-9933-9a42081d83be),SecurityGroupRule(a92fb3c5-f8ef-4f66-8ac6-d2db0f536581),SecurityGroupRule(d2f7bf9b-0131-4f20-932b-2486b72bcaad)],shared=False,stateful=True,updated_at=2022-09-27T04:27:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:32.006008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (ae58b0cf-9e83-420e-ac2f-ff9e704f9359), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:32.007037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:31Z,description=,direction='ingress',ethertype='IPv6',id=21ed1334-9051-44ca-82bc-311773568636,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7614a1b21d144efeb90a6e7ced0b9ed0',protocol=,remote_address_group_id=,remote_group_id=ae58b0cf-9e83-420e-ac2f-ff9e704f9359,remote_ip_prefix=,revision_number=0,security_group_id=ae58b0cf-9e83-420e-ac2f-ff9e704f9359,updated_at=2022-09-27T04:27:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:32.007684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (21ed1334-9051-44ca-82bc-311773568636), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:32.008405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Security group rule updated ['ae58b0cf-9e83-420e-ac2f-ff9e704f9359'] Sep 27 04:27:32.009717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:31Z,description=,direction='ingress',ethertype='IPv4',id=a1fb5981-7abd-4c16-9933-9a42081d83be,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7614a1b21d144efeb90a6e7ced0b9ed0',protocol=,remote_address_group_id=,remote_group_id=ae58b0cf-9e83-420e-ac2f-ff9e704f9359,remote_ip_prefix=,revision_number=0,security_group_id=ae58b0cf-9e83-420e-ac2f-ff9e704f9359,updated_at=2022-09-27T04:27:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:32.010576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a1fb5981-7abd-4c16-9933-9a42081d83be), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:32.011267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Security group rule updated ['ae58b0cf-9e83-420e-ac2f-ff9e704f9359'] Sep 27 04:27:32.012364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:31Z,description=,direction='egress',ethertype='IPv6',id=a92fb3c5-f8ef-4f66-8ac6-d2db0f536581,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7614a1b21d144efeb90a6e7ced0b9ed0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ae58b0cf-9e83-420e-ac2f-ff9e704f9359,updated_at=2022-09-27T04:27:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:32.012935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a92fb3c5-f8ef-4f66-8ac6-d2db0f536581), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:32.013668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Security group rule updated ['ae58b0cf-9e83-420e-ac2f-ff9e704f9359'] Sep 27 04:27:32.014739 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:31Z,description=,direction='egress',ethertype='IPv4',id=d2f7bf9b-0131-4f20-932b-2486b72bcaad,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7614a1b21d144efeb90a6e7ced0b9ed0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ae58b0cf-9e83-420e-ac2f-ff9e704f9359,updated_at=2022-09-27T04:27:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:32.015194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d2f7bf9b-0131-4f20-932b-2486b72bcaad), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:32.016332 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8bd0faa1-ee05-4a32-adf9-0afc967fd146 admin admin] Security group rule updated ['ae58b0cf-9e83-420e-ac2f-ff9e704f9359'] Sep 27 04:27:32.147300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Resource SecurityGroup deleted: ae58b0cf-9e83-420e-ac2f-ff9e704f9359 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:32.147971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (ae58b0cf-9e83-420e-ac2f-ff9e704f9359), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:32.148633 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ae58b0cf-9e83-420e-ac2f-ff9e704f9359',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:27:32.185842 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ae58b0cf-9e83-420e-ac2f-ff9e704f9359',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:27:32.187324 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Resource SecurityGroupRule deleted: 21ed1334-9051-44ca-82bc-311773568636 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:32.188049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (21ed1334-9051-44ca-82bc-311773568636), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:32.188918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Security group rule updated ['ae58b0cf-9e83-420e-ac2f-ff9e704f9359'] Sep 27 04:27:32.190732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Resource SecurityGroupRule deleted: a1fb5981-7abd-4c16-9933-9a42081d83be {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:32.191947 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a1fb5981-7abd-4c16-9933-9a42081d83be), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:32.192605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Security group rule updated ['ae58b0cf-9e83-420e-ac2f-ff9e704f9359'] Sep 27 04:27:32.193413 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Resource SecurityGroupRule deleted: a92fb3c5-f8ef-4f66-8ac6-d2db0f536581 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:32.194397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a92fb3c5-f8ef-4f66-8ac6-d2db0f536581), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:32.195095 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Security group rule updated ['ae58b0cf-9e83-420e-ac2f-ff9e704f9359'] Sep 27 04:27:32.195532 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Resource SecurityGroupRule deleted: d2f7bf9b-0131-4f20-932b-2486b72bcaad {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:32.196572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d2f7bf9b-0131-4f20-932b-2486b72bcaad), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:32.197153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2c8209b0-2a19-486d-9d29-d72d84d80b35 admin admin] Security group rule updated ['ae58b0cf-9e83-420e-ac2f-ff9e704f9359'] Sep 27 04:27:33.737070 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:465 started Sep 27 04:27:33.739884 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e11,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=564000000,duration_sec=943,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:33.740585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:33.741054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:465 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:35.737898 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:466 started Sep 27 04:27:35.740235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e13,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=564000000,duration_sec=945,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:35.740796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:35.741143 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:466 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:27:37.738744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:467 started Sep 27 04:27:37.741168 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e15,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=565000000,duration_sec=947,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:37.741783 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:37.742132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:467 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:39.739807 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:468 started Sep 27 04:27:39.742358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e17,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=567000000,duration_sec=949,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:39.743065 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:39.743472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:468 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:41.529452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:27:41Z,description='Default security group',id=300f680b-4aa7-4de7-a9f2-ee738027e326,is_default=True,name='default',project_id='cb019f622c4b488197b720549a9ffa73',revision_number=1,rules=[SecurityGroupRule(73aca9e4-2c31-47eb-874c-c798ff0e42d7),SecurityGroupRule(9d26111b-879c-43e9-8590-8827bc8f06a2),SecurityGroupRule(b8dc8e66-00eb-4539-9565-46186c64e7bf),SecurityGroupRule(d8267316-8bad-455a-8064-cef569c33978)],shared=False,stateful=True,updated_at=2022-09-27T04:27:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:41.530120 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (300f680b-4aa7-4de7-a9f2-ee738027e326), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:41.530609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:41Z,description=,direction='egress',ethertype='IPv4',id=73aca9e4-2c31-47eb-874c-c798ff0e42d7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb019f622c4b488197b720549a9ffa73',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=300f680b-4aa7-4de7-a9f2-ee738027e326,updated_at=2022-09-27T04:27:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:41.530964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (73aca9e4-2c31-47eb-874c-c798ff0e42d7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:41.531469 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Security group rule updated ['300f680b-4aa7-4de7-a9f2-ee738027e326'] Sep 27 04:27:41.532136 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:41Z,description=,direction='ingress',ethertype='IPv4',id=9d26111b-879c-43e9-8590-8827bc8f06a2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb019f622c4b488197b720549a9ffa73',protocol=,remote_address_group_id=,remote_group_id=300f680b-4aa7-4de7-a9f2-ee738027e326,remote_ip_prefix=,revision_number=0,security_group_id=300f680b-4aa7-4de7-a9f2-ee738027e326,updated_at=2022-09-27T04:27:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:41.532483 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9d26111b-879c-43e9-8590-8827bc8f06a2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:41.532808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Security group rule updated ['300f680b-4aa7-4de7-a9f2-ee738027e326'] Sep 27 04:27:41.533455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:41Z,description=,direction='egress',ethertype='IPv6',id=b8dc8e66-00eb-4539-9565-46186c64e7bf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb019f622c4b488197b720549a9ffa73',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=300f680b-4aa7-4de7-a9f2-ee738027e326,updated_at=2022-09-27T04:27:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:41.533821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b8dc8e66-00eb-4539-9565-46186c64e7bf), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:41.534145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Security group rule updated ['300f680b-4aa7-4de7-a9f2-ee738027e326'] Sep 27 04:27:41.534848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:41Z,description=,direction='ingress',ethertype='IPv6',id=d8267316-8bad-455a-8064-cef569c33978,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb019f622c4b488197b720549a9ffa73',protocol=,remote_address_group_id=,remote_group_id=300f680b-4aa7-4de7-a9f2-ee738027e326,remote_ip_prefix=,revision_number=0,security_group_id=300f680b-4aa7-4de7-a9f2-ee738027e326,updated_at=2022-09-27T04:27:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:41.535768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d8267316-8bad-455a-8064-cef569c33978), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:41.536088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e202796d-0ed4-46cd-8771-f5dbac1644b2 admin admin] Security group rule updated ['300f680b-4aa7-4de7-a9f2-ee738027e326'] Sep 27 04:27:41.672080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Resource SecurityGroup deleted: 300f680b-4aa7-4de7-a9f2-ee738027e326 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:41.672456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (300f680b-4aa7-4de7-a9f2-ee738027e326), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:41.673003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('300f680b-4aa7-4de7-a9f2-ee738027e326',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:27:41.685266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('300f680b-4aa7-4de7-a9f2-ee738027e326',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:27:41.685833 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Resource SecurityGroupRule deleted: 73aca9e4-2c31-47eb-874c-c798ff0e42d7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:41.686289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (73aca9e4-2c31-47eb-874c-c798ff0e42d7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:41.686688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Security group rule updated ['300f680b-4aa7-4de7-a9f2-ee738027e326'] Sep 27 04:27:41.687189 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Resource SecurityGroupRule deleted: 9d26111b-879c-43e9-8590-8827bc8f06a2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:41.687600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9d26111b-879c-43e9-8590-8827bc8f06a2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:41.688021 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Security group rule updated ['300f680b-4aa7-4de7-a9f2-ee738027e326'] Sep 27 04:27:41.688450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Resource SecurityGroupRule deleted: b8dc8e66-00eb-4539-9565-46186c64e7bf {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:41.688869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b8dc8e66-00eb-4539-9565-46186c64e7bf), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:41.689192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Security group rule updated ['300f680b-4aa7-4de7-a9f2-ee738027e326'] Sep 27 04:27:41.689617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Resource SecurityGroupRule deleted: d8267316-8bad-455a-8064-cef569c33978 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:41.690207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d8267316-8bad-455a-8064-cef569c33978), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:41.690586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-03131b32-4561-4d1c-92e3-e5c489e52355 admin admin] Security group rule updated ['300f680b-4aa7-4de7-a9f2-ee738027e326'] Sep 27 04:27:41.741125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:469 started Sep 27 04:27:41.744320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e19,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=568000000,duration_sec=951,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:41.744943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:41.745405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:469 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:42.076893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:27:41Z,description='Default security group',id=a634edba-9b62-4115-b7cb-2629894aa57b,is_default=True,name='default',project_id='cabea523b9aa4ee7a5fb7fadc9c53be8',revision_number=1,rules=[SecurityGroupRule(34490a34-ef88-449b-9d3b-6d0fcb2aedf0),SecurityGroupRule(3cece2aa-7ef4-40ae-8b35-fc0d33660e41),SecurityGroupRule(45b96c35-2e74-46ae-972b-4be873e2a566),SecurityGroupRule(9d7d97f4-8d74-481e-ab5d-ab5ffe597df5)],shared=False,stateful=True,updated_at=2022-09-27T04:27:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:42.076893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (a634edba-9b62-4115-b7cb-2629894aa57b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:42.077267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:41Z,description=,direction='ingress',ethertype='IPv6',id=34490a34-ef88-449b-9d3b-6d0fcb2aedf0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cabea523b9aa4ee7a5fb7fadc9c53be8',protocol=,remote_address_group_id=,remote_group_id=a634edba-9b62-4115-b7cb-2629894aa57b,remote_ip_prefix=,revision_number=0,security_group_id=a634edba-9b62-4115-b7cb-2629894aa57b,updated_at=2022-09-27T04:27:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:42.077831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (34490a34-ef88-449b-9d3b-6d0fcb2aedf0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:42.078361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Security group rule updated ['a634edba-9b62-4115-b7cb-2629894aa57b'] Sep 27 04:27:42.079045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:41Z,description=,direction='egress',ethertype='IPv6',id=3cece2aa-7ef4-40ae-8b35-fc0d33660e41,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cabea523b9aa4ee7a5fb7fadc9c53be8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a634edba-9b62-4115-b7cb-2629894aa57b,updated_at=2022-09-27T04:27:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:42.079406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3cece2aa-7ef4-40ae-8b35-fc0d33660e41), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:42.079737 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Security group rule updated ['a634edba-9b62-4115-b7cb-2629894aa57b'] Sep 27 04:27:42.080395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:41Z,description=,direction='egress',ethertype='IPv4',id=45b96c35-2e74-46ae-972b-4be873e2a566,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cabea523b9aa4ee7a5fb7fadc9c53be8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a634edba-9b62-4115-b7cb-2629894aa57b,updated_at=2022-09-27T04:27:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:42.080749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (45b96c35-2e74-46ae-972b-4be873e2a566), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:42.081140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Security group rule updated ['a634edba-9b62-4115-b7cb-2629894aa57b'] Sep 27 04:27:42.082413 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:41Z,description=,direction='ingress',ethertype='IPv4',id=9d7d97f4-8d74-481e-ab5d-ab5ffe597df5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cabea523b9aa4ee7a5fb7fadc9c53be8',protocol=,remote_address_group_id=,remote_group_id=a634edba-9b62-4115-b7cb-2629894aa57b,remote_ip_prefix=,revision_number=0,security_group_id=a634edba-9b62-4115-b7cb-2629894aa57b,updated_at=2022-09-27T04:27:41Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:42.082771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9d7d97f4-8d74-481e-ab5d-ab5ffe597df5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:42.083101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-a42319a3-bbed-4b3b-a155-2de8c8ceb6de admin admin] Security group rule updated ['a634edba-9b62-4115-b7cb-2629894aa57b'] Sep 27 04:27:42.210342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Resource SecurityGroup deleted: a634edba-9b62-4115-b7cb-2629894aa57b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:42.210720 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (a634edba-9b62-4115-b7cb-2629894aa57b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:42.211180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a634edba-9b62-4115-b7cb-2629894aa57b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:27:42.224460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a634edba-9b62-4115-b7cb-2629894aa57b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:27:42.225075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Resource SecurityGroupRule deleted: 34490a34-ef88-449b-9d3b-6d0fcb2aedf0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:42.225437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (34490a34-ef88-449b-9d3b-6d0fcb2aedf0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:42.225794 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Security group rule updated ['a634edba-9b62-4115-b7cb-2629894aa57b'] Sep 27 04:27:42.226187 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Resource SecurityGroupRule deleted: 3cece2aa-7ef4-40ae-8b35-fc0d33660e41 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:42.226541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3cece2aa-7ef4-40ae-8b35-fc0d33660e41), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:42.226877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Security group rule updated ['a634edba-9b62-4115-b7cb-2629894aa57b'] Sep 27 04:27:42.227280 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Resource SecurityGroupRule deleted: 45b96c35-2e74-46ae-972b-4be873e2a566 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:42.227615 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (45b96c35-2e74-46ae-972b-4be873e2a566), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:42.227928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Security group rule updated ['a634edba-9b62-4115-b7cb-2629894aa57b'] Sep 27 04:27:42.228291 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Resource SecurityGroupRule deleted: 9d7d97f4-8d74-481e-ab5d-ab5ffe597df5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:42.228631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9d7d97f4-8d74-481e-ab5d-ab5ffe597df5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:42.228943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5286e39d-44ee-4127-8726-ec922ac34429 admin admin] Security group rule updated ['a634edba-9b62-4115-b7cb-2629894aa57b'] Sep 27 04:27:43.742764 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:470 started Sep 27 04:27:43.745171 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e1b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=569000000,duration_sec=953,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:43.745799 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:43.746162 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:470 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:44.591510 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:27:44Z,description='Default security group',id=1a8715c7-c5d3-44ff-907c-44521898315f,is_default=True,name='default',project_id='4893e67386394cf39813dee5fb9acc07',revision_number=1,rules=[SecurityGroupRule(4244f2f9-45e7-465b-852f-5aebdd92fa37),SecurityGroupRule(4b2afb56-9959-4777-9b12-ac9fe86544c3),SecurityGroupRule(8ca9bb90-37ea-4477-96aa-884f1ce83885),SecurityGroupRule(e4512751-c0b0-4358-8286-67778903d684)],shared=False,stateful=True,updated_at=2022-09-27T04:27:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:44.591897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (1a8715c7-c5d3-44ff-907c-44521898315f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:44.592522 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:44Z,description=,direction='ingress',ethertype='IPv4',id=4244f2f9-45e7-465b-852f-5aebdd92fa37,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4893e67386394cf39813dee5fb9acc07',protocol=,remote_address_group_id=,remote_group_id=1a8715c7-c5d3-44ff-907c-44521898315f,remote_ip_prefix=,revision_number=0,security_group_id=1a8715c7-c5d3-44ff-907c-44521898315f,updated_at=2022-09-27T04:27:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:44.592880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4244f2f9-45e7-465b-852f-5aebdd92fa37), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:44.593217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Security group rule updated ['1a8715c7-c5d3-44ff-907c-44521898315f'] Sep 27 04:27:44.593909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:44Z,description=,direction='egress',ethertype='IPv6',id=4b2afb56-9959-4777-9b12-ac9fe86544c3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4893e67386394cf39813dee5fb9acc07',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1a8715c7-c5d3-44ff-907c-44521898315f,updated_at=2022-09-27T04:27:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:44.594266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4b2afb56-9959-4777-9b12-ac9fe86544c3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:44.594601 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Security group rule updated ['1a8715c7-c5d3-44ff-907c-44521898315f'] Sep 27 04:27:44.595285 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:44Z,description=,direction='ingress',ethertype='IPv6',id=8ca9bb90-37ea-4477-96aa-884f1ce83885,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4893e67386394cf39813dee5fb9acc07',protocol=,remote_address_group_id=,remote_group_id=1a8715c7-c5d3-44ff-907c-44521898315f,remote_ip_prefix=,revision_number=0,security_group_id=1a8715c7-c5d3-44ff-907c-44521898315f,updated_at=2022-09-27T04:27:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:44.595660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8ca9bb90-37ea-4477-96aa-884f1ce83885), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:44.595989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Security group rule updated ['1a8715c7-c5d3-44ff-907c-44521898315f'] Sep 27 04:27:44.596745 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:44Z,description=,direction='egress',ethertype='IPv4',id=e4512751-c0b0-4358-8286-67778903d684,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4893e67386394cf39813dee5fb9acc07',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1a8715c7-c5d3-44ff-907c-44521898315f,updated_at=2022-09-27T04:27:44Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:44.597101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e4512751-c0b0-4358-8286-67778903d684), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:44.597987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2114df09-728a-4eb5-86be-0f286c3b2b86 admin admin] Security group rule updated ['1a8715c7-c5d3-44ff-907c-44521898315f'] Sep 27 04:27:44.729868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Resource SecurityGroup deleted: 1a8715c7-c5d3-44ff-907c-44521898315f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:44.730243 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (1a8715c7-c5d3-44ff-907c-44521898315f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:44.730696 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1a8715c7-c5d3-44ff-907c-44521898315f',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:27:44.743393 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1a8715c7-c5d3-44ff-907c-44521898315f',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:27:44.744021 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Resource SecurityGroupRule deleted: 4244f2f9-45e7-465b-852f-5aebdd92fa37 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:44.744203 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4244f2f9-45e7-465b-852f-5aebdd92fa37), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:44.744539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Security group rule updated ['1a8715c7-c5d3-44ff-907c-44521898315f'] Sep 27 04:27:44.744927 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Resource SecurityGroupRule deleted: 4b2afb56-9959-4777-9b12-ac9fe86544c3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:44.745298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4b2afb56-9959-4777-9b12-ac9fe86544c3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:44.745613 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Security group rule updated ['1a8715c7-c5d3-44ff-907c-44521898315f'] Sep 27 04:27:44.746009 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Resource SecurityGroupRule deleted: 8ca9bb90-37ea-4477-96aa-884f1ce83885 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:44.746349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (8ca9bb90-37ea-4477-96aa-884f1ce83885), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:44.746663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Security group rule updated ['1a8715c7-c5d3-44ff-907c-44521898315f'] Sep 27 04:27:44.747020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Resource SecurityGroupRule deleted: e4512751-c0b0-4358-8286-67778903d684 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:44.747358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e4512751-c0b0-4358-8286-67778903d684), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:44.747668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3dde253c-28a2-4d05-bb4a-19de25e5d6b8 admin admin] Security group rule updated ['1a8715c7-c5d3-44ff-907c-44521898315f'] Sep 27 04:27:45.117550 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:27:45Z,description='Default security group',id=fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b,is_default=True,name='default',project_id='c977ddf6660b495491868fbce80717dd',revision_number=1,rules=[SecurityGroupRule(3f0c1632-482c-44be-a255-aa3b4cb388a0),SecurityGroupRule(803f6830-3436-487f-abf6-a5725a12a62f),SecurityGroupRule(8355e6b1-163d-4a76-829b-bf010eb93ec3),SecurityGroupRule(d6fc0f17-e666-4bad-93ce-74c0333b1a98)],shared=False,stateful=True,updated_at=2022-09-27T04:27:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:45.117974 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:45.118599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:45Z,description=,direction='egress',ethertype='IPv6',id=3f0c1632-482c-44be-a255-aa3b4cb388a0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c977ddf6660b495491868fbce80717dd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b,updated_at=2022-09-27T04:27:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:45.118957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (3f0c1632-482c-44be-a255-aa3b4cb388a0), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:45.119292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Security group rule updated ['fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b'] Sep 27 04:27:45.119963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:45Z,description=,direction='ingress',ethertype='IPv4',id=803f6830-3436-487f-abf6-a5725a12a62f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c977ddf6660b495491868fbce80717dd',protocol=,remote_address_group_id=,remote_group_id=fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b,remote_ip_prefix=,revision_number=0,security_group_id=fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b,updated_at=2022-09-27T04:27:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:45.120315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (803f6830-3436-487f-abf6-a5725a12a62f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:45.120644 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Security group rule updated ['fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b'] Sep 27 04:27:45.121326 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:45Z,description=,direction='ingress',ethertype='IPv6',id=8355e6b1-163d-4a76-829b-bf010eb93ec3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c977ddf6660b495491868fbce80717dd',protocol=,remote_address_group_id=,remote_group_id=fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b,remote_ip_prefix=,revision_number=0,security_group_id=fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b,updated_at=2022-09-27T04:27:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:45.121679 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (8355e6b1-163d-4a76-829b-bf010eb93ec3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:45.122031 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Security group rule updated ['fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b'] Sep 27 04:27:45.122675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:45Z,description=,direction='egress',ethertype='IPv4',id=d6fc0f17-e666-4bad-93ce-74c0333b1a98,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c977ddf6660b495491868fbce80717dd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b,updated_at=2022-09-27T04:27:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:45.123026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d6fc0f17-e666-4bad-93ce-74c0333b1a98), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:45.123354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1ceb5a2e-8909-40a2-b5bd-a511b1c46b92 admin admin] Security group rule updated ['fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b'] Sep 27 04:27:45.246925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Resource SecurityGroup deleted: fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:45.247543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:45.247984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:27:45.264279 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:27:45.264819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Resource SecurityGroupRule deleted: 3f0c1632-482c-44be-a255-aa3b4cb388a0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:45.265210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3f0c1632-482c-44be-a255-aa3b4cb388a0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:45.265543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Security group rule updated ['fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b'] Sep 27 04:27:45.265970 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Resource SecurityGroupRule deleted: 803f6830-3436-487f-abf6-a5725a12a62f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:45.266314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (803f6830-3436-487f-abf6-a5725a12a62f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:45.266632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Security group rule updated ['fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b'] Sep 27 04:27:45.267026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Resource SecurityGroupRule deleted: 8355e6b1-163d-4a76-829b-bf010eb93ec3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:45.267366 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (8355e6b1-163d-4a76-829b-bf010eb93ec3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:45.267707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Security group rule updated ['fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b'] Sep 27 04:27:45.268072 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Resource SecurityGroupRule deleted: d6fc0f17-e666-4bad-93ce-74c0333b1a98 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:45.268407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d6fc0f17-e666-4bad-93ce-74c0333b1a98), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:45.268718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ec5973ed-ede9-4120-bb59-ed24e2a9f586 admin admin] Security group rule updated ['fb372e0e-4e70-4509-90c7-ce2a0c9ceb7b'] Sep 27 04:27:45.743765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:471 started Sep 27 04:27:45.746279 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e1d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=570000000,duration_sec=955,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:45.746847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:45.747204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:471 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:47.745112 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:472 started Sep 27 04:27:47.748506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e1f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=572000000,duration_sec=957,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:47.749351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:47.749914 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:472 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:27:49.632476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:27:49Z,description='Default security group',id=a16cd9bd-ba34-4db4-afa2-ef33b1b50160,is_default=True,name='default',project_id='429b10571c42414d8400f0b2c58772ac',revision_number=1,rules=[SecurityGroupRule(62369b61-287e-413e-a195-5b27a51c6622),SecurityGroupRule(99548d6d-8dcb-40fd-8bb0-cd5d7755a139),SecurityGroupRule(d767de46-610e-4b63-9564-c67ff2b20519),SecurityGroupRule(e11ae2fb-34cd-4b1d-b5da-2be09cc5e8ba)],shared=False,stateful=True,updated_at=2022-09-27T04:27:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:49.633081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (a16cd9bd-ba34-4db4-afa2-ef33b1b50160), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:49.633474 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:49Z,description=,direction='ingress',ethertype='IPv4',id=62369b61-287e-413e-a195-5b27a51c6622,normalized_cidr=None,port_range_max=,port_range_min=,project_id='429b10571c42414d8400f0b2c58772ac',protocol=,remote_address_group_id=,remote_group_id=a16cd9bd-ba34-4db4-afa2-ef33b1b50160,remote_ip_prefix=,revision_number=0,security_group_id=a16cd9bd-ba34-4db4-afa2-ef33b1b50160,updated_at=2022-09-27T04:27:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:49.633859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (62369b61-287e-413e-a195-5b27a51c6622), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:49.634199 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Security group rule updated ['a16cd9bd-ba34-4db4-afa2-ef33b1b50160'] Sep 27 04:27:49.634916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:49Z,description=,direction='ingress',ethertype='IPv6',id=99548d6d-8dcb-40fd-8bb0-cd5d7755a139,normalized_cidr=None,port_range_max=,port_range_min=,project_id='429b10571c42414d8400f0b2c58772ac',protocol=,remote_address_group_id=,remote_group_id=a16cd9bd-ba34-4db4-afa2-ef33b1b50160,remote_ip_prefix=,revision_number=0,security_group_id=a16cd9bd-ba34-4db4-afa2-ef33b1b50160,updated_at=2022-09-27T04:27:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:49.635265 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (99548d6d-8dcb-40fd-8bb0-cd5d7755a139), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:49.635596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Security group rule updated ['a16cd9bd-ba34-4db4-afa2-ef33b1b50160'] Sep 27 04:27:49.636242 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:49Z,description=,direction='egress',ethertype='IPv4',id=d767de46-610e-4b63-9564-c67ff2b20519,normalized_cidr=None,port_range_max=,port_range_min=,project_id='429b10571c42414d8400f0b2c58772ac',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a16cd9bd-ba34-4db4-afa2-ef33b1b50160,updated_at=2022-09-27T04:27:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:49.636781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d767de46-610e-4b63-9564-c67ff2b20519), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:49.637112 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Security group rule updated ['a16cd9bd-ba34-4db4-afa2-ef33b1b50160'] Sep 27 04:27:49.637777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:27:49Z,description=,direction='egress',ethertype='IPv6',id=e11ae2fb-34cd-4b1d-b5da-2be09cc5e8ba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='429b10571c42414d8400f0b2c58772ac',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a16cd9bd-ba34-4db4-afa2-ef33b1b50160,updated_at=2022-09-27T04:27:49Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:27:49.638387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e11ae2fb-34cd-4b1d-b5da-2be09cc5e8ba), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:49.638717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-747759dc-a77a-4f4f-8734-e252341dd731 admin admin] Security group rule updated ['a16cd9bd-ba34-4db4-afa2-ef33b1b50160'] Sep 27 04:27:49.746344 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:473 started Sep 27 04:27:49.749049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e21,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=573000000,duration_sec=959,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:49.749628 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:49.750023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:473 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:49.769189 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Resource SecurityGroup deleted: a16cd9bd-ba34-4db4-afa2-ef33b1b50160 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:49.769572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (a16cd9bd-ba34-4db4-afa2-ef33b1b50160), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:49.770056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a16cd9bd-ba34-4db4-afa2-ef33b1b50160',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:27:49.788085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a16cd9bd-ba34-4db4-afa2-ef33b1b50160',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:27:49.788549 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Resource SecurityGroupRule deleted: 62369b61-287e-413e-a195-5b27a51c6622 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:49.788975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (62369b61-287e-413e-a195-5b27a51c6622), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:49.789451 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Security group rule updated ['a16cd9bd-ba34-4db4-afa2-ef33b1b50160'] Sep 27 04:27:49.789990 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Resource SecurityGroupRule deleted: 99548d6d-8dcb-40fd-8bb0-cd5d7755a139 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:49.790343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (99548d6d-8dcb-40fd-8bb0-cd5d7755a139), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:49.790991 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Security group rule updated ['a16cd9bd-ba34-4db4-afa2-ef33b1b50160'] Sep 27 04:27:49.791358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Resource SecurityGroupRule deleted: d767de46-610e-4b63-9564-c67ff2b20519 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:49.791698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d767de46-610e-4b63-9564-c67ff2b20519), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:49.792015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Security group rule updated ['a16cd9bd-ba34-4db4-afa2-ef33b1b50160'] Sep 27 04:27:49.792383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Resource SecurityGroupRule deleted: e11ae2fb-34cd-4b1d-b5da-2be09cc5e8ba {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:27:49.792720 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e11ae2fb-34cd-4b1d-b5da-2be09cc5e8ba), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:49.793311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-01edfd25-3024-4ce5-aa5b-7dd613461ec5 admin admin] Security group rule updated ['a16cd9bd-ba34-4db4-afa2-ef33b1b50160'] Sep 27 04:27:50.116924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port eb918bb7-1383-468a-8553-7476aae953bb updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:50.117421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (eb918bb7-1383-468a-8553-7476aae953bb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:51.747574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:474 started Sep 27 04:27:51.750802 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e23,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=574000000,duration_sec=961,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:51.751384 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:51.751714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:474 - starting polling. Elapsed:0.004 Sep 27 04:27:51.754226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:51.756799 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:474 - port information retrieved. Elapsed:0.009 Sep 27 04:27:51.757131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:474 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:27:53.748953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:475 started Sep 27 04:27:53.751874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e25,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=576000000,duration_sec=963,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:53.752632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:53.753100 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:475 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:27:55.749328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:476 started Sep 27 04:27:55.751817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e27,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=576000000,duration_sec=965,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:55.752441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:55.752799 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:476 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:27:57.750204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:477 started Sep 27 04:27:57.752569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e29,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=577000000,duration_sec=967,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:57.753136 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:57.753487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:477 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:27:58.164411 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port eb918bb7-1383-468a-8553-7476aae953bb updated (revision_number 6->7). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:27:58.164798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (eb918bb7-1383-468a-8553-7476aae953bb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:59.751685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:478 started Sep 27 04:27:59.754171 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e2b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=578000000,duration_sec=969,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:27:59.755237 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:27:59.755575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:478 - starting polling. Elapsed:0.004 Sep 27 04:27:59.757639 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:27:59.760180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:478 - port information retrieved. Elapsed:0.009 Sep 27 04:27:59.760512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:478 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:28:00.137249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port eb918bb7-1383-468a-8553-7476aae953bb updated (revision_number 7->8). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:28:00.137635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (eb918bb7-1383-468a-8553-7476aae953bb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.088767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:28:00Z,description='Default security group',id=c0287ef8-b180-4c73-aab0-b9b84370050b,is_default=True,name='default',project_id='bb59f3d23e774836b006cce9b9d9b2b1',revision_number=1,rules=[SecurityGroupRule(04334b92-8344-4acf-ba6d-2dd353735630),SecurityGroupRule(7061cb18-7234-4fbd-97b7-bedd9b0f2449),SecurityGroupRule(7ccdce14-ae76-402e-b638-55ef3974a90f),SecurityGroupRule(d1e3e5fe-03b5-4281-bf55-67044a068cf7)],shared=False,stateful=True,updated_at=2022-09-27T04:28:01Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:01.089341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (c0287ef8-b180-4c73-aab0-b9b84370050b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.090132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:01Z,description=,direction='egress',ethertype='IPv6',id=04334b92-8344-4acf-ba6d-2dd353735630,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb59f3d23e774836b006cce9b9d9b2b1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c0287ef8-b180-4c73-aab0-b9b84370050b,updated_at=2022-09-27T04:28:01Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:01.090563 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (04334b92-8344-4acf-ba6d-2dd353735630), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.090970 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Security group rule updated ['c0287ef8-b180-4c73-aab0-b9b84370050b'] Sep 27 04:28:01.091657 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:01Z,description=,direction='ingress',ethertype='IPv6',id=7061cb18-7234-4fbd-97b7-bedd9b0f2449,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb59f3d23e774836b006cce9b9d9b2b1',protocol=,remote_address_group_id=,remote_group_id=c0287ef8-b180-4c73-aab0-b9b84370050b,remote_ip_prefix=,revision_number=0,security_group_id=c0287ef8-b180-4c73-aab0-b9b84370050b,updated_at=2022-09-27T04:28:01Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:01.092015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7061cb18-7234-4fbd-97b7-bedd9b0f2449), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.092348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Security group rule updated ['c0287ef8-b180-4c73-aab0-b9b84370050b'] Sep 27 04:28:01.093014 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:00Z,description=,direction='ingress',ethertype='IPv4',id=7ccdce14-ae76-402e-b638-55ef3974a90f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb59f3d23e774836b006cce9b9d9b2b1',protocol=,remote_address_group_id=,remote_group_id=c0287ef8-b180-4c73-aab0-b9b84370050b,remote_ip_prefix=,revision_number=0,security_group_id=c0287ef8-b180-4c73-aab0-b9b84370050b,updated_at=2022-09-27T04:28:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:01.093370 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7ccdce14-ae76-402e-b638-55ef3974a90f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.093699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Security group rule updated ['c0287ef8-b180-4c73-aab0-b9b84370050b'] Sep 27 04:28:01.094377 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:01Z,description=,direction='egress',ethertype='IPv4',id=d1e3e5fe-03b5-4281-bf55-67044a068cf7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb59f3d23e774836b006cce9b9d9b2b1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c0287ef8-b180-4c73-aab0-b9b84370050b,updated_at=2022-09-27T04:28:01Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:01.094729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d1e3e5fe-03b5-4281-bf55-67044a068cf7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.095073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-86bc85bf-cdd8-441b-84cc-1333fa8bc2a5 admin admin] Security group rule updated ['c0287ef8-b180-4c73-aab0-b9b84370050b'] Sep 27 04:28:01.218718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Resource SecurityGroup deleted: c0287ef8-b180-4c73-aab0-b9b84370050b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:28:01.219190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (c0287ef8-b180-4c73-aab0-b9b84370050b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.219688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c0287ef8-b180-4c73-aab0-b9b84370050b',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:28:01.232264 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c0287ef8-b180-4c73-aab0-b9b84370050b',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:28:01.232798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Resource SecurityGroupRule deleted: 04334b92-8344-4acf-ba6d-2dd353735630 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:28:01.233263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (04334b92-8344-4acf-ba6d-2dd353735630), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.233712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Security group rule updated ['c0287ef8-b180-4c73-aab0-b9b84370050b'] Sep 27 04:28:01.234206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Resource SecurityGroupRule deleted: 7061cb18-7234-4fbd-97b7-bedd9b0f2449 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:28:01.234661 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7061cb18-7234-4fbd-97b7-bedd9b0f2449), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.235063 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Security group rule updated ['c0287ef8-b180-4c73-aab0-b9b84370050b'] Sep 27 04:28:01.235552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Resource SecurityGroupRule deleted: 7ccdce14-ae76-402e-b638-55ef3974a90f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:28:01.235962 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7ccdce14-ae76-402e-b638-55ef3974a90f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.236347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Security group rule updated ['c0287ef8-b180-4c73-aab0-b9b84370050b'] Sep 27 04:28:01.236803 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Resource SecurityGroupRule deleted: d1e3e5fe-03b5-4281-bf55-67044a068cf7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:28:01.237204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d1e3e5fe-03b5-4281-bf55-67044a068cf7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.237590 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7d529a43-c519-47e1-af3d-fa168b91c02b admin admin] Security group rule updated ['c0287ef8-b180-4c73-aab0-b9b84370050b'] Sep 27 04:28:01.752908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:479 started Sep 27 04:28:01.755899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e2d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=580000000,duration_sec=971,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:01.756866 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:01.757210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:479 - starting polling. Elapsed:0.005 Sep 27 04:28:01.759444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:01.762012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:479 - port information retrieved. Elapsed:0.009 Sep 27 04:28:01.762346 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:479 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:28:03.753342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:480 started Sep 27 04:28:03.755993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e2f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=580000000,duration_sec=973,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:03.756558 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:03.756906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:480 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:05.754361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:481 started Sep 27 04:28:05.757238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e31,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=581000000,duration_sec=975,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:05.757823 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:05.758181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:481 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:07.755540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:482 started Sep 27 04:28:07.757942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e33,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=582000000,duration_sec=977,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:07.758508 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:07.758859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:482 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:09.483494 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:28:09Z,description='Default security group',id=60c15b71-4771-41b4-a383-29325f68b187,is_default=True,name='default',project_id='1d545844780f4499b411252f186139e7',revision_number=1,rules=[SecurityGroupRule(1b16d251-df63-4702-a75b-403c5771a00c),SecurityGroupRule(7d97f2d1-21ae-4f23-92b5-1c063af07825),SecurityGroupRule(bd8b78a0-5000-4baf-803f-a2d73b5921af),SecurityGroupRule(cb1a1645-12f0-4d37-a2cd-7a91727b91c1)],shared=False,stateful=True,updated_at=2022-09-27T04:28:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:09.484091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (60c15b71-4771-41b4-a383-29325f68b187), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:09.484613 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:09Z,description=,direction='egress',ethertype='IPv4',id=1b16d251-df63-4702-a75b-403c5771a00c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1d545844780f4499b411252f186139e7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=60c15b71-4771-41b4-a383-29325f68b187,updated_at=2022-09-27T04:28:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:09.484978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1b16d251-df63-4702-a75b-403c5771a00c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:09.485316 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Security group rule updated ['60c15b71-4771-41b4-a383-29325f68b187'] Sep 27 04:28:09.486096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:09Z,description=,direction='ingress',ethertype='IPv4',id=7d97f2d1-21ae-4f23-92b5-1c063af07825,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1d545844780f4499b411252f186139e7',protocol=,remote_address_group_id=,remote_group_id=60c15b71-4771-41b4-a383-29325f68b187,remote_ip_prefix=,revision_number=0,security_group_id=60c15b71-4771-41b4-a383-29325f68b187,updated_at=2022-09-27T04:28:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:09.486395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (7d97f2d1-21ae-4f23-92b5-1c063af07825), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:09.486725 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Security group rule updated ['60c15b71-4771-41b4-a383-29325f68b187'] Sep 27 04:28:09.487390 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:09Z,description=,direction='ingress',ethertype='IPv6',id=bd8b78a0-5000-4baf-803f-a2d73b5921af,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1d545844780f4499b411252f186139e7',protocol=,remote_address_group_id=,remote_group_id=60c15b71-4771-41b4-a383-29325f68b187,remote_ip_prefix=,revision_number=0,security_group_id=60c15b71-4771-41b4-a383-29325f68b187,updated_at=2022-09-27T04:28:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:09.487740 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (bd8b78a0-5000-4baf-803f-a2d73b5921af), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:09.488066 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Security group rule updated ['60c15b71-4771-41b4-a383-29325f68b187'] Sep 27 04:28:09.488883 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:09Z,description=,direction='egress',ethertype='IPv6',id=cb1a1645-12f0-4d37-a2cd-7a91727b91c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1d545844780f4499b411252f186139e7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=60c15b71-4771-41b4-a383-29325f68b187,updated_at=2022-09-27T04:28:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:09.489844 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cb1a1645-12f0-4d37-a2cd-7a91727b91c1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:09.490176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-525b18be-31c0-4f64-9af8-d735a63ee2b0 admin admin] Security group rule updated ['60c15b71-4771-41b4-a383-29325f68b187'] Sep 27 04:28:09.629732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Resource SecurityGroup deleted: 60c15b71-4771-41b4-a383-29325f68b187 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:28:09.630239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (60c15b71-4771-41b4-a383-29325f68b187), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:09.630857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('60c15b71-4771-41b4-a383-29325f68b187',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:28:09.648641 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('60c15b71-4771-41b4-a383-29325f68b187',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:28:09.649296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Resource SecurityGroupRule deleted: 1b16d251-df63-4702-a75b-403c5771a00c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:28:09.649972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1b16d251-df63-4702-a75b-403c5771a00c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:09.650407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Security group rule updated ['60c15b71-4771-41b4-a383-29325f68b187'] Sep 27 04:28:09.650896 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Resource SecurityGroupRule deleted: 7d97f2d1-21ae-4f23-92b5-1c063af07825 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:28:09.652759 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7d97f2d1-21ae-4f23-92b5-1c063af07825), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:09.653191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Security group rule updated ['60c15b71-4771-41b4-a383-29325f68b187'] Sep 27 04:28:09.654240 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Resource SecurityGroupRule deleted: bd8b78a0-5000-4baf-803f-a2d73b5921af {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:28:09.654240 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (bd8b78a0-5000-4baf-803f-a2d73b5921af), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:09.654701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Security group rule updated ['60c15b71-4771-41b4-a383-29325f68b187'] Sep 27 04:28:09.655166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Resource SecurityGroupRule deleted: cb1a1645-12f0-4d37-a2cd-7a91727b91c1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:28:09.655637 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cb1a1645-12f0-4d37-a2cd-7a91727b91c1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:09.656067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3e7e60c3-50e1-4c62-98ac-2911e26b0733 admin admin] Security group rule updated ['60c15b71-4771-41b4-a383-29325f68b187'] Sep 27 04:28:09.755727 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:483 started Sep 27 04:28:09.758333 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e35,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=582000000,duration_sec=979,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:09.759044 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:09.759493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:483 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:11.757016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:484 started Sep 27 04:28:11.759508 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e37,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=584000000,duration_sec=981,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:11.760077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:11.760421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:484 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:13.758343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:485 started Sep 27 04:28:13.760573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e39,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=585000000,duration_sec=983,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:13.761140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:13.761488 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:485 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:15.759066 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:486 started Sep 27 04:28:15.761862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e3b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=586000000,duration_sec=985,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:15.762442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:15.762795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:486 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:16.177924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-af45b79a-2751-489b-88ec-45633578a343 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:28:16Z,description='tempest-description--1156030038',id=c4927577-2d33-474f-b56a-68c5be7b7b7e,is_default=False,name='tempest-securitygroup--1844079817',project_id='d7c74ffec54740eca3cd6b707f1cb732',revision_number=1,rules=[SecurityGroupRule(14bb11fe-afa3-4fed-8909-8e58f99b7436),SecurityGroupRule(16431106-0fe2-47dc-bafb-c58c2e53b59c)],shared=False,stateful=True,updated_at=2022-09-27T04:28:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:16.178316 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-af45b79a-2751-489b-88ec-45633578a343 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (c4927577-2d33-474f-b56a-68c5be7b7b7e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:16.178949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-af45b79a-2751-489b-88ec-45633578a343 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:16Z,description=,direction='egress',ethertype='IPv4',id=14bb11fe-afa3-4fed-8909-8e58f99b7436,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c4927577-2d33-474f-b56a-68c5be7b7b7e,updated_at=2022-09-27T04:28:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:16.179439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-af45b79a-2751-489b-88ec-45633578a343 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (14bb11fe-afa3-4fed-8909-8e58f99b7436), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:16.179790 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-af45b79a-2751-489b-88ec-45633578a343 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['c4927577-2d33-474f-b56a-68c5be7b7b7e'] Sep 27 04:28:16.180470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-af45b79a-2751-489b-88ec-45633578a343 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:16Z,description=,direction='egress',ethertype='IPv6',id=16431106-0fe2-47dc-bafb-c58c2e53b59c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c4927577-2d33-474f-b56a-68c5be7b7b7e,updated_at=2022-09-27T04:28:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:16.180832 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-af45b79a-2751-489b-88ec-45633578a343 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (16431106-0fe2-47dc-bafb-c58c2e53b59c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:16.181170 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-af45b79a-2751-489b-88ec-45633578a343 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['c4927577-2d33-474f-b56a-68c5be7b7b7e'] Sep 27 04:28:16.287807 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-83b5a4c0-508b-470c-aa5c-d1f5c27139d0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:16Z,description='',direction='ingress',ethertype='IPv4',id=e5050c7e-5137-4642-bae7-55315f44bcfe,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c4927577-2d33-474f-b56a-68c5be7b7b7e,updated_at=2022-09-27T04:28:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:16.288218 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-83b5a4c0-508b-470c-aa5c-d1f5c27139d0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e5050c7e-5137-4642-bae7-55315f44bcfe), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:16.288713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-83b5a4c0-508b-470c-aa5c-d1f5c27139d0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['c4927577-2d33-474f-b56a-68c5be7b7b7e'] Sep 27 04:28:16.413422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c726f33e-d2ce-4066-aec1-6d578a046107 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:28:16Z,description='',direction='ingress',ethertype='IPv4',id=9f75dcbd-bbbe-4f8b-91b1-2061f7cca44f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c4927577-2d33-474f-b56a-68c5be7b7b7e,updated_at=2022-09-27T04:28:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:16.413842 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c726f33e-d2ce-4066-aec1-6d578a046107 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9f75dcbd-bbbe-4f8b-91b1-2061f7cca44f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:16.414193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c726f33e-d2ce-4066-aec1-6d578a046107 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['c4927577-2d33-474f-b56a-68c5be7b7b7e'] Sep 27 04:28:16.819317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30675f93-daca-4141-a8a9-90a87729fbcc tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:28:16Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b3be32c3-e1a2-4d1b-92f1-8b2f2bd987ec,mac_address=fa:16:3e:b5:f2:d0,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b3be32c3-e1a2-4d1b-92f1-8b2f2bd987ec),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:28:16Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:16.819961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30675f93-daca-4141-a8a9-90a87729fbcc tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b3be32c3-e1a2-4d1b-92f1-8b2f2bd987ec), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:17.162657 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30675f93-daca-4141-a8a9-90a87729fbcc tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port b3be32c3-e1a2-4d1b-92f1-8b2f2bd987ec updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '62ea260a-f254-4b0a-8fc5-6b7b65a006a8'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:28:17.163090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30675f93-daca-4141-a8a9-90a87729fbcc tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (b3be32c3-e1a2-4d1b-92f1-8b2f2bd987ec), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:17.759771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:487 started Sep 27 04:28:17.762249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e3d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=586000000,duration_sec=987,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:17.762836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:17.763358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:487 - starting polling. Elapsed:0.004 Sep 27 04:28:17.765460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:17.768177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:487 - port information retrieved. Elapsed:0.009 Sep 27 04:28:17.768516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:487 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:28:19.648026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4dbf5cab-1bc6-49a3-9d74-f37c4aee8ca9 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:28:19Z,data_plane_status=None,description='',device_id='7842fec9-9ef4-47fb-b9ff-987b5ba3468b',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=765ce5cc-318e-4b81-afac-627ffadfa36a,mac_address=fa:16:3e:ad:04:23,name='',network_id=cba0fe06-d029-4450-9dfd-fb0123caa50b,numa_affinity_policy=,project_id='d7c74ffec54740eca3cd6b707f1cb732',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(765ce5cc-318e-4b81-afac-627ffadfa36a),security_group_ids=set([c4927577-2d33-474f-b56a-68c5be7b7b7e]),status='DOWN',updated_at=2022-09-27T04:28:19Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:28:19.648668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4dbf5cab-1bc6-49a3-9d74-f37c4aee8ca9 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (765ce5cc-318e-4b81-afac-627ffadfa36a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:19.649040 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4dbf5cab-1bc6-49a3-9d74-f37c4aee8ca9 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group member updated {'c4927577-2d33-474f-b56a-68c5be7b7b7e'} Sep 27 04:28:19.761014 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:488 started Sep 27 04:28:19.763623 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e3f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=588000000,duration_sec=989,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:19.764200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:19.764812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:488 - starting polling. Elapsed:0.004 Sep 27 04:28:19.767023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:19.769561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:488 - port information retrieved. Elapsed:0.009 Sep 27 04:28:19.769943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:488 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:28:20.116970 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-404063f0-40c3-4214-91ea-01ce92e5657b service neutron] Resource Port 765ce5cc-318e-4b81-afac-627ffadfa36a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=765ce5cc-318e-4b81-afac-627ffadfa36a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=765ce5cc-318e-4b81-afac-627ffadfa36a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:28:20.120144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-404063f0-40c3-4214-91ea-01ce92e5657b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (765ce5cc-318e-4b81-afac-627ffadfa36a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:20.377662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-404063f0-40c3-4214-91ea-01ce92e5657b service neutron] Resource Port 765ce5cc-318e-4b81-afac-627ffadfa36a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=765ce5cc-318e-4b81-afac-627ffadfa36a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=765ce5cc-318e-4b81-afac-627ffadfa36a,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=765ce5cc-318e-4b81-afac-627ffadfa36a,segment=NetworkSegment(c5746d98-25dd-46c1-b1b6-0887fcb5090c),segment_id=c5746d98-25dd-46c1-b1b6-0887fcb5090c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:28:20.378173 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-404063f0-40c3-4214-91ea-01ce92e5657b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (765ce5cc-318e-4b81-afac-627ffadfa36a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:21.762235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:489 started Sep 27 04:28:21.764860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e41,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=589000000,duration_sec=991,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:21.765444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:21.765890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:489 - starting polling. Elapsed:0.004 Sep 27 04:28:21.767906 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:21.770510 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:489 - port information retrieved. Elapsed:0.008 Sep 27 04:28:21.770851 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:489 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:28:23.763572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:490 started Sep 27 04:28:23.765863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e43,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=590000000,duration_sec=993,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:23.766423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:23.766771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:490 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:24.222707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 765ce5cc-318e-4b81-afac-627ffadfa36a updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:28:24.223097 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (765ce5cc-318e-4b81-afac-627ffadfa36a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:25.764319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:491 started Sep 27 04:28:25.766707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e45,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=591000000,duration_sec=995,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:25.767281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:25.767625 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:491 - starting polling. Elapsed:0.004 Sep 27 04:28:25.769647 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:25.772708 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:491 - port information retrieved. Elapsed:0.009 Sep 27 04:28:25.773050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:491 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:28:26.228827 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 765ce5cc-318e-4b81-afac-627ffadfa36a updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:28:26.229269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (765ce5cc-318e-4b81-afac-627ffadfa36a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:27.765664 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:492 started Sep 27 04:28:27.768394 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e47,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=593000000,duration_sec=997,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:27.768967 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:27.769302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:492 - starting polling. Elapsed:0.004 Sep 27 04:28:27.771359 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:28:27.773897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:492 - port information retrieved. Elapsed:0.008 Sep 27 04:28:27.774230 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:492 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:28:29.766777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:493 started Sep 27 04:28:29.769419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e49,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=594000000,duration_sec=999,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:29.770027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:29.770449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:493 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:31.768098 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:494 started Sep 27 04:28:31.770542 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e4b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=595000000,duration_sec=1001,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:31.771102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:31.771449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:494 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:33.769194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:495 started Sep 27 04:28:33.772086 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e4d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=596000000,duration_sec=1003,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:33.772657 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:33.773014 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:495 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:35.770663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:496 started Sep 27 04:28:35.773018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e4f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=597000000,duration_sec=1005,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:35.773588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:35.773966 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:496 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:37.771296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:497 started Sep 27 04:28:37.773713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=598000000,duration_sec=1007,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:37.774315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:37.774670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:497 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:39.772190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:498 started Sep 27 04:28:39.774993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e53,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=599000000,duration_sec=1009,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:39.775570 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:39.775925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:498 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:41.773393 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:499 started Sep 27 04:28:41.775783 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e55,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=600000000,duration_sec=1011,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:41.776351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:41.776706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:499 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:43.774031 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:500 started Sep 27 04:28:43.776302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e57,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=601000000,duration_sec=1013,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:43.776851 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:43.777223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:500 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:45.775158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:501 started Sep 27 04:28:45.777467 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e59,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=602000000,duration_sec=1015,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:45.778055 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:45.778406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:501 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:47.775773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:502 started Sep 27 04:28:47.778173 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=602000000,duration_sec=1017,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:47.778733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:47.779078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:502 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:49.776955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:503 started Sep 27 04:28:49.779337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e5d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=604000000,duration_sec=1019,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:49.779911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:49.780265 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:503 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:51.778282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:504 started Sep 27 04:28:51.781077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=605000000,duration_sec=1021,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:51.781675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:51.782068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:504 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:28:53.779548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:505 started Sep 27 04:28:53.781801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e61,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=606000000,duration_sec=1023,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:53.782372 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:53.782747 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:505 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:55.780925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:506 started Sep 27 04:28:55.783269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=607000000,duration_sec=1025,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:55.783843 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:55.784196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:506 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:57.781653 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:507 started Sep 27 04:28:57.784049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e65,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=608000000,duration_sec=1027,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:57.784612 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:57.784961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:507 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:28:59.782974 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:508 started Sep 27 04:28:59.785301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=610000000,duration_sec=1029,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:28:59.786422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:28:59.786778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:508 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:29:01.784128 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:509 started Sep 27 04:29:01.787047 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e69,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=611000000,duration_sec=1031,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:01.787617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:01.787972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:509 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:29:03.785020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:510 started Sep 27 04:29:03.787256 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e6b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=612000000,duration_sec=1033,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:03.787831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:03.788185 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:510 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:29:05.785519 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:511 started Sep 27 04:29:05.787857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e6d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=612000000,duration_sec=1035,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:05.788418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:05.788767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:511 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:29:07.786729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:512 started Sep 27 04:29:07.789153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=613000000,duration_sec=1037,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:07.789727 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:07.790104 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:512 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:29:08.594980 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-eda455c3-1e58-4c98-8011-fdf74ec2648f tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port deleted: 765ce5cc-318e-4b81-afac-627ffadfa36a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:08.595670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-eda455c3-1e58-4c98-8011-fdf74ec2648f tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (765ce5cc-318e-4b81-afac-627ffadfa36a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:08.596144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-eda455c3-1e58-4c98-8011-fdf74ec2648f tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group member updated {'c4927577-2d33-474f-b56a-68c5be7b7b7e'} Sep 27 04:29:09.787394 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:513 started Sep 27 04:29:09.789847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e71,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=614000000,duration_sec=1039,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:09.790855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:09.791207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:513 - starting polling. Elapsed:0.004 Sep 27 04:29:09.793694 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:09.795130 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 765ce5cc-318e-4b81-afac-627ffadfa36a not present in bridge br-int Sep 27 04:29:09.795469 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:29:09.795757 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['765ce5cc-318e-4b81-afac-627ffadfa36a'] Sep 27 04:29:09.796084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 765ce5cc-318e-4b81-afac-627ffadfa36a is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:29:09.798626 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:513 - port information retrieved. Elapsed:0.011 Sep 27 04:29:09.798954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:513 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:29:09.917986 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroup deleted: c4927577-2d33-474f-b56a-68c5be7b7b7e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:09.918695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (c4927577-2d33-474f-b56a-68c5be7b7b7e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:09.919632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c4927577-2d33-474f-b56a-68c5be7b7b7e',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:29:09.932870 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c4927577-2d33-474f-b56a-68c5be7b7b7e',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:29:09.933333 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: 14bb11fe-afa3-4fed-8909-8e58f99b7436 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:09.933706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (14bb11fe-afa3-4fed-8909-8e58f99b7436), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:09.934067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['c4927577-2d33-474f-b56a-68c5be7b7b7e'] Sep 27 04:29:09.934461 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: 16431106-0fe2-47dc-bafb-c58c2e53b59c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:09.934820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (16431106-0fe2-47dc-bafb-c58c2e53b59c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:09.935113 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['c4927577-2d33-474f-b56a-68c5be7b7b7e'] Sep 27 04:29:09.935573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: e5050c7e-5137-4642-bae7-55315f44bcfe {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:09.935836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e5050c7e-5137-4642-bae7-55315f44bcfe), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:09.936212 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['c4927577-2d33-474f-b56a-68c5be7b7b7e'] Sep 27 04:29:09.936889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: 9f75dcbd-bbbe-4f8b-91b1-2061f7cca44f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:09.937106 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9f75dcbd-bbbe-4f8b-91b1-2061f7cca44f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:09.937429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2d2b9b12-444b-4fcf-bac0-a3afc9fc1e57 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['c4927577-2d33-474f-b56a-68c5be7b7b7e'] Sep 27 04:29:10.278809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ed3bdfb2-903b-48aa-851f-831295d4b8fc tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port deleted: b3be32c3-e1a2-4d1b-92f1-8b2f2bd987ec {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:10.279129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ed3bdfb2-903b-48aa-851f-831295d4b8fc tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (b3be32c3-e1a2-4d1b-92f1-8b2f2bd987ec), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:11.788059 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:514 started Sep 27 04:29:11.790507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e73,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=615000000,duration_sec=1041,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:11.791085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:11.791425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:514 - starting polling. Elapsed:0.004 Sep 27 04:29:11.793788 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:11.795139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b3be32c3-e1a2-4d1b-92f1-8b2f2bd987ec not present in bridge br-int Sep 27 04:29:11.795473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:29:11.795872 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['b3be32c3-e1a2-4d1b-92f1-8b2f2bd987ec'] Sep 27 04:29:11.796206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port b3be32c3-e1a2-4d1b-92f1-8b2f2bd987ec is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:29:11.799051 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:514 - port information retrieved. Elapsed:0.011 Sep 27 04:29:11.799387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:514 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:29:13.788736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:515 started Sep 27 04:29:13.791091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=615000000,duration_sec=1043,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:13.791668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:13.792029 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:515 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:29:14.024226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-04fd2240-909f-4015-a2ab-f0a0045e7cb3 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource Port deleted: 05230db1-5556-4943-8805-ed0952617e69 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:14.024668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-04fd2240-909f-4015-a2ab-f0a0045e7cb3 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (05230db1-5556-4943-8805-ed0952617e69), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:15.789548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:516 started Sep 27 04:29:15.791945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=616000000,duration_sec=1045,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:15.792516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:15.792856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:516 - starting polling. Elapsed:0.003 Sep 27 04:29:15.795120 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:15.796478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 05230db1-5556-4943-8805-ed0952617e69 not present in bridge br-int Sep 27 04:29:15.796815 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:29:15.797104 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['05230db1-5556-4943-8805-ed0952617e69'] Sep 27 04:29:15.797436 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 05230db1-5556-4943-8805-ed0952617e69 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:29:15.799953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:516 - port information retrieved. Elapsed:0.011 Sep 27 04:29:15.800290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:516 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:29:16.439326 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4dcd12df-a6d4-4803-b8be-6769de650fe8 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port deleted: 59621d87-e6fa-445c-98d8-2f933c046f0d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:16.439910 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4dcd12df-a6d4-4803-b8be-6769de650fe8 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (59621d87-e6fa-445c-98d8-2f933c046f0d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:16.440502 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4dcd12df-a6d4-4803-b8be-6769de650fe8 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group member updated {'faa72a12-bdbd-4886-bc21-c1494225c046'} Sep 27 04:29:17.074135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e859694-536c-431c-81a5-cd1299d80ca0 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource Port deleted: eb918bb7-1383-468a-8553-7476aae953bb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:17.076175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e859694-536c-431c-81a5-cd1299d80ca0 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (eb918bb7-1383-468a-8553-7476aae953bb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:17.076596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1e859694-536c-431c-81a5-cd1299d80ca0 tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group member updated {'ed46206f-12d5-4819-aa08-0f95f9ac185f'} Sep 27 04:29:17.791023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:517 started Sep 27 04:29:17.793779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=618000000,duration_sec=1047,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:17.794358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:17.794699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:517 - starting polling. Elapsed:0.004 Sep 27 04:29:17.796698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:17.798124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port eb918bb7-1383-468a-8553-7476aae953bb not present in bridge br-int Sep 27 04:29:17.798497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:29:17.799752 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 59621d87-e6fa-445c-98d8-2f933c046f0d not present in bridge br-int Sep 27 04:29:17.800073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:29:17.800361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['59621d87-e6fa-445c-98d8-2f933c046f0d', 'eb918bb7-1383-468a-8553-7476aae953bb'] Sep 27 04:29:17.800685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 59621d87-e6fa-445c-98d8-2f933c046f0d is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:29:17.800984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port eb918bb7-1383-468a-8553-7476aae953bb is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:29:17.804922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:517 - port information retrieved. Elapsed:0.014 Sep 27 04:29:17.805284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:517 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 27 04:29:18.415093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource SecurityGroup deleted: ed46206f-12d5-4819-aa08-0f95f9ac185f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:18.415755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (ed46206f-12d5-4819-aa08-0f95f9ac185f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:18.415926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ed46206f-12d5-4819-aa08-0f95f9ac185f',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:29:18.447155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ed46206f-12d5-4819-aa08-0f95f9ac185f',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:29:18.447611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource SecurityGroupRule deleted: 0b55560f-1b4f-4619-93b3-0a7f02584dd0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:18.447988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0b55560f-1b4f-4619-93b3-0a7f02584dd0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:18.448328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:29:18.448731 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource SecurityGroupRule deleted: 464f31e3-84d9-4da0-a8ca-c8dc1644e35e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:18.449084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (464f31e3-84d9-4da0-a8ca-c8dc1644e35e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:18.449405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:29:18.450177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource SecurityGroupRule deleted: d3b4b24a-3c98-4534-b0b0-b10f46cb790a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:18.450624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d3b4b24a-3c98-4534-b0b0-b10f46cb790a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:18.450988 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:29:18.451532 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource SecurityGroupRule deleted: a0b28a24-5c19-4d18-b033-de0f89741aee {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:18.451999 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a0b28a24-5c19-4d18-b033-de0f89741aee), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:18.452340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:29:18.452796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource SecurityGroupRule deleted: 619563f9-61bd-4994-877d-298a30c43755 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:18.453186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (619563f9-61bd-4994-877d-298a30c43755), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:18.453572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:29:18.454051 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource SecurityGroupRule deleted: b53a6263-f24b-4dc9-b49f-52148e56e6d5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:18.454467 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b53a6263-f24b-4dc9-b49f-52148e56e6d5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:18.454876 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:29:18.455287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource SecurityGroupRule deleted: 33b32542-6f7c-4172-b5a3-184202a6d272 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:18.455756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (33b32542-6f7c-4172-b5a3-184202a6d272), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:18.456265 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:29:18.456871 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Resource SecurityGroupRule deleted: 9a94e02b-9ab1-4598-a7fa-26b38f04cd9b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:18.457441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9a94e02b-9ab1-4598-a7fa-26b38f04cd9b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:18.458634 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3350a1c7-8558-47cb-9ef6-62d5c1954e1f tempest-TestShelveInstance-1290579173 tempest-TestShelveInstance-1290579173-project] Security group rule updated ['ed46206f-12d5-4819-aa08-0f95f9ac185f'] Sep 27 04:29:18.999428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroup deleted: faa72a12-bdbd-4886-bc21-c1494225c046 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:19.000107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (faa72a12-bdbd-4886-bc21-c1494225c046), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:19.000446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('faa72a12-bdbd-4886-bc21-c1494225c046',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:29:19.023239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('faa72a12-bdbd-4886-bc21-c1494225c046',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:29:19.023683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: 7f60767d-ee5d-4633-9484-31ea6b54793c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:19.024069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7f60767d-ee5d-4633-9484-31ea6b54793c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:19.024409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['faa72a12-bdbd-4886-bc21-c1494225c046'] Sep 27 04:29:19.025140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: 92d9cebc-01d7-4c42-af5e-ba0af500399e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:19.025500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (92d9cebc-01d7-4c42-af5e-ba0af500399e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:19.025855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['faa72a12-bdbd-4886-bc21-c1494225c046'] Sep 27 04:29:19.026237 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: c4b58927-5b09-48af-8037-f493ac37afde {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:19.026590 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c4b58927-5b09-48af-8037-f493ac37afde), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:19.026920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['faa72a12-bdbd-4886-bc21-c1494225c046'] Sep 27 04:29:19.027292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: 3907d43f-37d7-4298-aaeb-bca798d96e2f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:19.027895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (3907d43f-37d7-4298-aaeb-bca798d96e2f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:19.028300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-424e82e2-5f06-478f-a331-9c168c619b1b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['faa72a12-bdbd-4886-bc21-c1494225c046'] Sep 27 04:29:19.579476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4fc0dcb2-6c49-442f-b1ff-ebb9c180e689 admin admin] Resource Port deleted: e4db657b-a959-4e62-b211-2cb063d743eb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:19.580105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4fc0dcb2-6c49-442f-b1ff-ebb9c180e689 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (e4db657b-a959-4e62-b211-2cb063d743eb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:19.668306 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e8629400-80a6-436c-8ad9-ff0c5423aec6 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port deleted: d455b83d-5534-45ca-8572-246bb2fd7a89 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:19.668947 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e8629400-80a6-436c-8ad9-ff0c5423aec6 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (d455b83d-5534-45ca-8572-246bb2fd7a89), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:19.797392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:518 started Sep 27 04:29:19.799995 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=624000000,duration_sec=1049,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:19.801235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:19.802124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:518 - starting polling. Elapsed:0.004 Sep 27 04:29:19.804121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:19.805485 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port d455b83d-5534-45ca-8572-246bb2fd7a89 not present in bridge br-int Sep 27 04:29:19.805845 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:29:19.808652 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-e4db657b-a9, col_values=(('tag', 4095),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:19.815645 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e7d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:19.816038 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['e4db657b-a959-4e62-b211-2cb063d743eb', 'd455b83d-5534-45ca-8572-246bb2fd7a89'] Sep 27 04:29:19.816611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port d455b83d-5534-45ca-8572-246bb2fd7a89 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:29:19.817196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:19.862304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5b8530-5e3b-41aa-803e-2be153f707fa]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:19.865595 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:518 - port information retrieved. Elapsed:0.068 Sep 27 04:29:19.865969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:518 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.069 Sep 27 04:29:20.001699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9281011d-9828-4ac9-8a94-a36a0e9dbde0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:29:19Z,description='tempest-description--361296776',id=4a95c94b-f7bf-4515-9419-e7b1d0b5acb8,is_default=False,name='tempest-securitygroup--1985755080',project_id='d7c74ffec54740eca3cd6b707f1cb732',revision_number=1,rules=[SecurityGroupRule(84c0a003-0315-4c00-a00e-7b9bfc0ec35b),SecurityGroupRule(dbd70611-fd20-47b8-a127-2af2082e2f82)],shared=False,stateful=True,updated_at=2022-09-27T04:29:19Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:20.002376 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9281011d-9828-4ac9-8a94-a36a0e9dbde0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (4a95c94b-f7bf-4515-9419-e7b1d0b5acb8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:20.003193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9281011d-9828-4ac9-8a94-a36a0e9dbde0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:19Z,description=,direction='egress',ethertype='IPv6',id=84c0a003-0315-4c00-a00e-7b9bfc0ec35b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a95c94b-f7bf-4515-9419-e7b1d0b5acb8,updated_at=2022-09-27T04:29:19Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:20.003561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9281011d-9828-4ac9-8a94-a36a0e9dbde0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (84c0a003-0315-4c00-a00e-7b9bfc0ec35b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:20.003902 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9281011d-9828-4ac9-8a94-a36a0e9dbde0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['4a95c94b-f7bf-4515-9419-e7b1d0b5acb8'] Sep 27 04:29:20.005105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9281011d-9828-4ac9-8a94-a36a0e9dbde0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:19Z,description=,direction='egress',ethertype='IPv4',id=dbd70611-fd20-47b8-a127-2af2082e2f82,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a95c94b-f7bf-4515-9419-e7b1d0b5acb8,updated_at=2022-09-27T04:29:19Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:20.005452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9281011d-9828-4ac9-8a94-a36a0e9dbde0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (dbd70611-fd20-47b8-a127-2af2082e2f82), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:20.005810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9281011d-9828-4ac9-8a94-a36a0e9dbde0 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['4a95c94b-f7bf-4515-9419-e7b1d0b5acb8'] Sep 27 04:29:20.131024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ce186df5-6cfb-46e4-a8fa-77488ae6404a tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:20Z,description='',direction='ingress',ethertype='IPv4',id=6bfb1e27-5b51-4675-a93d-c34f83a4b30a,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a95c94b-f7bf-4515-9419-e7b1d0b5acb8,updated_at=2022-09-27T04:29:20Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:20.131428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ce186df5-6cfb-46e4-a8fa-77488ae6404a tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6bfb1e27-5b51-4675-a93d-c34f83a4b30a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:20.131976 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ce186df5-6cfb-46e4-a8fa-77488ae6404a tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['4a95c94b-f7bf-4515-9419-e7b1d0b5acb8'] Sep 27 04:29:20.259689 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-644453f1-addc-4bbc-acb9-4468d6028335 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:20Z,description='',direction='ingress',ethertype='IPv4',id=393cae3a-ff7e-4362-ae6f-80b37919c8ac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a95c94b-f7bf-4515-9419-e7b1d0b5acb8,updated_at=2022-09-27T04:29:20Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:20.260340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-644453f1-addc-4bbc-acb9-4468d6028335 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (393cae3a-ff7e-4362-ae6f-80b37919c8ac), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:20.260691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-644453f1-addc-4bbc-acb9-4468d6028335 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['4a95c94b-f7bf-4515-9419-e7b1d0b5acb8'] Sep 27 04:29:21.218770 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0d88cba3-046c-4222-9085-c50136737ca7","delete","qr-e4db657b-a9",25,["map",[["attached-mac","fa:16:3e:06:b0:80"],["iface-id","e4db657b-a959-4e62-b211-2cb063d743eb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:21.228750 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d1e779de-78f7-4545-b515-d85909c7c678 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:29:20Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=bc88f6f6-e6a2-488d-aaab-c4dd91f3b3e3,mac_address=fa:16:3e:81:01:eb,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(bc88f6f6-e6a2-488d-aaab-c4dd91f3b3e3),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:29:20Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:21.229075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d1e779de-78f7-4545-b515-d85909c7c678 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bc88f6f6-e6a2-488d-aaab-c4dd91f3b3e3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:21.612731 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ddbfc405-74b6-42a1-9a47-20cca121097c admin admin] Resource Port deleted: 53a249dc-eefb-49ff-a291-f2eda1664fe8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:21.613568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ddbfc405-74b6-42a1-9a47-20cca121097c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (53a249dc-eefb-49ff-a291-f2eda1664fe8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:21.798619 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:519 started Sep 27 04:29:21.801227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e7f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=625000000,duration_sec=1051,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:21.802072 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:21.802588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:519 - starting polling. Elapsed:0.004 Sep 27 04:29:21.804708 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:21.807622 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-53a249dc-ee, col_values=(('tag', 4095),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:21.814893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e81,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:21.815288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['53a249dc-eefb-49ff-a291-f2eda1664fe8'] Sep 27 04:29:21.815733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:21.858646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71ae78b-07f9-45b2-9a9e-5603090fd105]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:21.864836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e83,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:21.865713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:519 - port information retrieved. Elapsed:0.067 Sep 27 04:29:21.866170 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'fe4ecad8-9126-45df-830c-fb2391ce585d', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', '53a249dc-eefb-49ff-a291-f2eda1664fe8', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': set(), 'removed': {'e4db657b-a959-4e62-b211-2cb063d743eb'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:21.866764 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:519 - agent port security group processed in 0.000 Sep 27 04:29:21.869006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:29:21.869389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'e4db657b-a959-4e62-b211-2cb063d743eb'} Sep 27 04:29:21.869726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port e4db657b-a959-4e62-b211-2cb063d743eb is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:29:21.870086 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'e4db657b-a959-4e62-b211-2cb063d743eb'} removed Sep 27 04:29:21.897631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:29:21.898364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:29:21.898664 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:519 - treat_devices_removed completed in 0.029 Sep 27 04:29:21.898977 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:519 - ports processed. Elapsed:0.101 Sep 27 04:29:21.899308 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:519 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.101 Sep 27 04:29:21.948771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d1e779de-78f7-4545-b515-d85909c7c678 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port bc88f6f6-e6a2-488d-aaab-c4dd91f3b3e3 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '31823bbb-e6a1-4e73-8287-05f3a101b261'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:21.949816 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d1e779de-78f7-4545-b515-d85909c7c678 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (bc88f6f6-e6a2-488d-aaab-c4dd91f3b3e3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:22.072695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7b44b2b1-6b3a-4963-a1a8-b36027018057","delete","qg-53a249dc-ee",26,["map",[["attached-mac","fa:16:3e:ff:61:24"],["iface-id","53a249dc-eefb-49ff-a291-f2eda1664fe8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:22.315828 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-12377e88-1097-4869-bb84-857200fe0d35 admin admin] Resource Subnet deleted: c8446e81-8757-4a92-bbb2-c6d0f12abe74 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:22.316458 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-12377e88-1097-4869-bb84-857200fe0d35 admin admin] Publish callbacks [] for Subnet (c8446e81-8757-4a92-bbb2-c6d0f12abe74), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:22.487577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8ab30ab0-cef6-4bc0-9553-70419bda8eca","delete","tap7297f2f3-0e",24,["map",[["attached-mac","fa:16:3e:f6:50:51"],["iface-id","7297f2f3-0ebd-4cf2-93a1-8e981779a0f0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:22.699888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e6e054a6-96a7-4e8d-a60b-bf75412489e6 admin admin] Resource Port deleted: 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:22.702450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e6e054a6-96a7-4e8d-a60b-bf75412489e6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (7297f2f3-0ebd-4cf2-93a1-8e981779a0f0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:22.794317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c0367350-40b5-4299-874e-076dbb72b60f None None] Resource Port deleted: 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:22.794763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c0367350-40b5-4299-874e-076dbb72b60f None None] Skipped duplicate delete event for 7297f2f3-0ebd-4cf2-93a1-8e981779a0f0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 27 04:29:22.940702 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e6e054a6-96a7-4e8d-a60b-bf75412489e6 admin admin] Resource Network deleted: 41cd98f9-b206-4445-9870-d24633bca602 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:22.941374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e6e054a6-96a7-4e8d-a60b-bf75412489e6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (41cd98f9-b206-4445-9870-d24633bca602), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:23.799811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:520 started Sep 27 04:29:23.802247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e85,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=626000000,duration_sec=1053,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:23.804015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:23.804456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:520 - starting polling. Elapsed:0.005 Sep 27 04:29:23.806561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:23.809403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0b643410-0235-41f3-a9b7-70c6ec5387fe admin admin] Resource Port deleted: a63caa9f-d00b-46f8-b114-8c8c7bc3b115 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:23.809797 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0b643410-0235-41f3-a9b7-70c6ec5387fe admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (a63caa9f-d00b-46f8-b114-8c8c7bc3b115), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:23.812714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e87,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:23.814790 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e89,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:23.815103 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:520 - port information retrieved. Elapsed:0.015 Sep 27 04:29:23.815430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'fe4ecad8-9126-45df-830c-fb2391ce585d', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': set(), 'removed': {'53a249dc-eefb-49ff-a291-f2eda1664fe8', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:23.815759 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:520 - agent port security group processed in 0.000 Sep 27 04:29:23.817799 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:29:23.818306 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'53a249dc-eefb-49ff-a291-f2eda1664fe8', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0'} Sep 27 04:29:23.818834 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 53a249dc-eefb-49ff-a291-f2eda1664fe8 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:29:23.819463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:23.866145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff60b67-acfe-4030-9229-60d1f28fab2f]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:23.866741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'53a249dc-eefb-49ff-a291-f2eda1664fe8', '7297f2f3-0ebd-4cf2-93a1-8e981779a0f0'} removed Sep 27 04:29:23.918124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:29:23.919011 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:29:23.919454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 10 from net-id = 41cd98f9-b206-4445-9870-d24633bca602, seg-id = 144 Sep 27 04:29:23.923987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32ebf,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:23.926644 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc22e8b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4240}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:23.927294 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:520 - treat_devices_removed completed in 0.109 Sep 27 04:29:23.927595 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:520 - ports processed. Elapsed:0.128 Sep 27 04:29:23.928168 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:520 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.128 Sep 27 04:29:25.001176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e8efda0e-e7be-448a-a69c-b2160155d618 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:29:24Z,data_plane_status=None,description='',device_id='af03ef64-1418-4b7a-a0ee-1294cedb21a1',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9cf35c89-da17-4b43-a211-771d19ddbbf2,mac_address=fa:16:3e:e9:b4:cf,name='',network_id=cba0fe06-d029-4450-9dfd-fb0123caa50b,numa_affinity_policy=,project_id='d7c74ffec54740eca3cd6b707f1cb732',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9cf35c89-da17-4b43-a211-771d19ddbbf2),security_group_ids=set([4a95c94b-f7bf-4515-9419-e7b1d0b5acb8]),status='DOWN',updated_at=2022-09-27T04:29:24Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:25.001803 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e8efda0e-e7be-448a-a69c-b2160155d618 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9cf35c89-da17-4b43-a211-771d19ddbbf2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:25.002078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e8efda0e-e7be-448a-a69c-b2160155d618 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group member updated {'4a95c94b-f7bf-4515-9419-e7b1d0b5acb8'} Sep 27 04:29:25.202360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-aa39dee4-ffbf-4308-b114-99a763668d51 admin admin] Resource Port deleted: fe4ecad8-9126-45df-830c-fb2391ce585d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:25.203075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-aa39dee4-ffbf-4308-b114-99a763668d51 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (fe4ecad8-9126-45df-830c-fb2391ce585d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:25.210869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["38400a48-6da1-4c3f-b4c5-ef4a39e54250","delete","qr-a63caa9f-d0",28,["map",[["attached-mac","fa:16:3e:a8:7a:35"],["iface-id","a63caa9f-d00b-46f8-b114-8c8c7bc3b115"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:25.634616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["35e85150-41a1-423f-99a7-531c056d8edd","delete","qg-fe4ecad8-91",29,["map",[["attached-mac","fa:16:3e:58:f1:e9"],["iface-id","fe4ecad8-9126-45df-830c-fb2391ce585d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:25.787113 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d587e478-a86a-4b2d-acf4-6af5e755a793 admin admin] Resource Subnet deleted: ace747cf-2ef4-4c62-b777-44656539b2e3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:25.787514 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d587e478-a86a-4b2d-acf4-6af5e755a793 admin admin] Publish callbacks [] for Subnet (ace747cf-2ef4-4c62-b777-44656539b2e3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:25.800949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:521 started Sep 27 04:29:25.826370 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-18997744-f2a8-491c-a16e-bba2f621f8bf service neutron] Resource Port 9cf35c89-da17-4b43-a211-771d19ddbbf2 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=9cf35c89-da17-4b43-a211-771d19ddbbf2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=9cf35c89-da17-4b43-a211-771d19ddbbf2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:25.826927 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-18997744-f2a8-491c-a16e-bba2f621f8bf service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9cf35c89-da17-4b43-a211-771d19ddbbf2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:25.941257 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e8d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=754000000,duration_sec=1055,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:25.952191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:25.954341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:521 - starting polling. Elapsed:0.153 Sep 27 04:29:25.960856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:25.968192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d5a373a3-7eb0-492d-a550-3268d1e326a8","delete","tapc74bfff2-6b",27,["map",[["attached-mac","fa:16:3e:ae:1d:61"],["iface-id","c74bfff2-6b41-4e9a-bba6-dfaded2b10c0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:25.986995 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e8f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:25.988812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e91,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:25.989784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:521 - port information retrieved. Elapsed:0.188 Sep 27 04:29:25.990107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', 'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': set(), 'removed': {'fe4ecad8-9126-45df-830c-fb2391ce585d', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:25.990433 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:521 - agent port security group processed in 0.000 Sep 27 04:29:25.991890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:29:25.992659 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'fe4ecad8-9126-45df-830c-fb2391ce585d', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115'} Sep 27 04:29:25.993189 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 8 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:26.045502 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e628c96e-1037-4c2b-85b4-5ad693d4476a]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:26.046107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'fe4ecad8-9126-45df-830c-fb2391ce585d', 'a63caa9f-d00b-46f8-b114-8c8c7bc3b115'} removed Sep 27 04:29:26.138607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:29:26.139088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:521 - treat_devices_removed completed in 0.147 Sep 27 04:29:26.139397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:521 - ports processed. Elapsed:0.339 Sep 27 04:29:26.140124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:521 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.339 Sep 27 04:29:26.197362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5c7d9979-b4eb-4f8a-9c79-1f1d60274cca admin admin] Resource Port deleted: c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:26.197687 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5c7d9979-b4eb-4f8a-9c79-1f1d60274cca admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (c74bfff2-6b41-4e9a-bba6-dfaded2b10c0), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:26.243529 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-18997744-f2a8-491c-a16e-bba2f621f8bf service neutron] Resource Port 9cf35c89-da17-4b43-a211-771d19ddbbf2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=9cf35c89-da17-4b43-a211-771d19ddbbf2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=9cf35c89-da17-4b43-a211-771d19ddbbf2,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=9cf35c89-da17-4b43-a211-771d19ddbbf2,segment=NetworkSegment(c5746d98-25dd-46c1-b1b6-0887fcb5090c),segment_id=c5746d98-25dd-46c1-b1b6-0887fcb5090c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:26.244204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-18997744-f2a8-491c-a16e-bba2f621f8bf service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9cf35c89-da17-4b43-a211-771d19ddbbf2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:26.297024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3c6bf745-2160-410e-a4de-f31d4a0b1b1a None None] Resource Port deleted: c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:26.297400 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3c6bf745-2160-410e-a4de-f31d4a0b1b1a None None] Skipped duplicate delete event for c74bfff2-6b41-4e9a-bba6-dfaded2b10c0 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 27 04:29:26.753802 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5c7d9979-b4eb-4f8a-9c79-1f1d60274cca admin admin] Resource Network deleted: 5a310953-8b80-4c4f-86d4-ab083fbc1003 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:26.754449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5c7d9979-b4eb-4f8a-9c79-1f1d60274cca admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (5a310953-8b80-4c4f-86d4-ab083fbc1003), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.068028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Resource SecurityGroup deleted: 845607bb-5721-41b8-b96a-c86c4440186e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:27.068617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (845607bb-5721-41b8-b96a-c86c4440186e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.068993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('845607bb-5721-41b8-b96a-c86c4440186e',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:29:27.081863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('845607bb-5721-41b8-b96a-c86c4440186e',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:29:27.082296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Resource SecurityGroupRule deleted: 01aaf3b8-c568-4b45-8755-1d6e65197b23 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:27.083187 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (01aaf3b8-c568-4b45-8755-1d6e65197b23), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.083555 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Security group rule updated ['845607bb-5721-41b8-b96a-c86c4440186e'] Sep 27 04:29:27.083949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Resource SecurityGroupRule deleted: 30e7d628-7157-4275-8550-9477f50caa60 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:27.084297 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (30e7d628-7157-4275-8550-9477f50caa60), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.084621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Security group rule updated ['845607bb-5721-41b8-b96a-c86c4440186e'] Sep 27 04:29:27.085000 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Resource SecurityGroupRule deleted: 7776ca34-b59b-464e-a5b6-5e3ab76f6f8e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:27.085346 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (7776ca34-b59b-464e-a5b6-5e3ab76f6f8e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.085667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Security group rule updated ['845607bb-5721-41b8-b96a-c86c4440186e'] Sep 27 04:29:27.086082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Resource SecurityGroupRule deleted: d2940b0a-e64c-411b-a73e-ad4c64bf10f7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:27.086427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d2940b0a-e64c-411b-a73e-ad4c64bf10f7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.086746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1c2bbe8d-ee3f-4462-a062-d6d0a6b306bc admin admin] Security group rule updated ['845607bb-5721-41b8-b96a-c86c4440186e'] Sep 27 04:29:27.553833 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Resource SecurityGroup deleted: 896ea457-a0ac-4630-8bb9-fe121ebeac4d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:27.554398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (896ea457-a0ac-4630-8bb9-fe121ebeac4d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.554948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('896ea457-a0ac-4630-8bb9-fe121ebeac4d',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:29:27.569040 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('896ea457-a0ac-4630-8bb9-fe121ebeac4d',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:29:27.569518 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Resource SecurityGroupRule deleted: 59c66021-677b-4850-9c8a-7f0774ccb077 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:27.570023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (59c66021-677b-4850-9c8a-7f0774ccb077), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.570392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Security group rule updated ['896ea457-a0ac-4630-8bb9-fe121ebeac4d'] Sep 27 04:29:27.570832 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Resource SecurityGroupRule deleted: b58bffdd-ca37-4987-a0da-8ad79d609fb2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:27.571921 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b58bffdd-ca37-4987-a0da-8ad79d609fb2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.572221 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Security group rule updated ['896ea457-a0ac-4630-8bb9-fe121ebeac4d'] Sep 27 04:29:27.572907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Resource SecurityGroupRule deleted: e5564a17-879e-44c1-bebe-8126c3e555ed {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:27.573290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e5564a17-879e-44c1-bebe-8126c3e555ed), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.573616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Security group rule updated ['896ea457-a0ac-4630-8bb9-fe121ebeac4d'] Sep 27 04:29:27.574082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Resource SecurityGroupRule deleted: fa0ace9c-0c7f-4ab9-b4f2-a4e4097fa4b2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:29:27.574605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (fa0ace9c-0c7f-4ab9-b4f2-a4e4097fa4b2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.574993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6de1266e-c63a-45c1-8afd-b10d67863821 admin admin] Security group rule updated ['896ea457-a0ac-4630-8bb9-fe121ebeac4d'] Sep 27 04:29:27.801992 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:522 started Sep 27 04:29:27.804593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e93,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=629000000,duration_sec=1057,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:27.805949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:27.806590 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:522 - starting polling. Elapsed:0.005 Sep 27 04:29:27.808554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:27.812275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e95,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:27.812857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:522 - port information retrieved. Elapsed:0.011 Sep 27 04:29:27.813282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': set(), 'removed': {'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:27.813606 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:522 - agent port security group processed in 0.000 Sep 27 04:29:27.815098 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:29:27.815536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0'} Sep 27 04:29:27.815978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:27.859460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7f6faf-5a93-47e7-8bed-3f7864c3ff08]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:27.860445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'c74bfff2-6b41-4e9a-bba6-dfaded2b10c0'} removed Sep 27 04:29:27.892052 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:29:27.896158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 11 from net-id = 5a310953-8b80-4c4f-86d4-ab083fbc1003, seg-id = 139 Sep 27 04:29:27.896158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32ec1,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:27.900748 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc22e97,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4235}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:27.900748 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:522 - treat_devices_removed completed in 0.084 Sep 27 04:29:27.900748 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:522 - ports processed. Elapsed:0.098 Sep 27 04:29:27.900748 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:522 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.098 Sep 27 04:29:28.519368 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:29:28Z,description='Default security group',id=070b0cf7-b41b-479d-a997-2fb12fe1fdad,is_default=True,name='default',project_id='53d86b6e8a8343fca03ca6d38200f23f',revision_number=1,rules=[SecurityGroupRule(375a5786-4fe8-4a93-b886-b72ab07aae3d),SecurityGroupRule(6f5f2d57-e127-43b9-88e8-f7dee7fdd246),SecurityGroupRule(9f42c337-b3a9-4f49-97d4-e3839e3d14ba),SecurityGroupRule(c1a309cf-db0a-4db6-a4c2-391d7b103bbb)],shared=False,stateful=True,updated_at=2022-09-27T04:29:28Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:28.520581 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (070b0cf7-b41b-479d-a997-2fb12fe1fdad), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:28.521389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:28Z,description=,direction='egress',ethertype='IPv4',id=375a5786-4fe8-4a93-b886-b72ab07aae3d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=070b0cf7-b41b-479d-a997-2fb12fe1fdad,updated_at=2022-09-27T04:29:28Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:28.521880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (375a5786-4fe8-4a93-b886-b72ab07aae3d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:28.522321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Security group rule updated ['070b0cf7-b41b-479d-a997-2fb12fe1fdad'] Sep 27 04:29:28.523079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:28Z,description=,direction='ingress',ethertype='IPv4',id=6f5f2d57-e127-43b9-88e8-f7dee7fdd246,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol=,remote_address_group_id=,remote_group_id=070b0cf7-b41b-479d-a997-2fb12fe1fdad,remote_ip_prefix=,revision_number=0,security_group_id=070b0cf7-b41b-479d-a997-2fb12fe1fdad,updated_at=2022-09-27T04:29:28Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:28.523767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6f5f2d57-e127-43b9-88e8-f7dee7fdd246), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:28.524431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Security group rule updated ['070b0cf7-b41b-479d-a997-2fb12fe1fdad'] Sep 27 04:29:28.525311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:28Z,description=,direction='egress',ethertype='IPv6',id=9f42c337-b3a9-4f49-97d4-e3839e3d14ba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=070b0cf7-b41b-479d-a997-2fb12fe1fdad,updated_at=2022-09-27T04:29:28Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:28.525970 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9f42c337-b3a9-4f49-97d4-e3839e3d14ba), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:28.526318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Security group rule updated ['070b0cf7-b41b-479d-a997-2fb12fe1fdad'] Sep 27 04:29:28.526994 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:28Z,description=,direction='ingress',ethertype='IPv6',id=c1a309cf-db0a-4db6-a4c2-391d7b103bbb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol=,remote_address_group_id=,remote_group_id=070b0cf7-b41b-479d-a997-2fb12fe1fdad,remote_ip_prefix=,revision_number=0,security_group_id=070b0cf7-b41b-479d-a997-2fb12fe1fdad,updated_at=2022-09-27T04:29:28Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:28.527354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c1a309cf-db0a-4db6-a4c2-391d7b103bbb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:28.527692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Security group rule updated ['070b0cf7-b41b-479d-a997-2fb12fe1fdad'] Sep 27 04:29:28.551058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 9cf35c89-da17-4b43-a211-771d19ddbbf2 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:28.552245 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9cf35c89-da17-4b43-a211-771d19ddbbf2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:28.662736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:29:28Z,description='',dns_domain=None,id=df4f6840-004b-4387-a687-683e2895186f,mtu=1500,name='tempest-TestVolumeBootPattern-815580073-network',project_id='53d86b6e8a8343fca03ca6d38200f23f',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(df4f6840-004b-4387-a687-683e2895186f),segments=[NetworkSegment(3855b0db-49a1-4957-864c-539480ffde2c)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:29:28Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:28.663130 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (df4f6840-004b-4387-a687-683e2895186f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-58c7a7f0-b82c-4dc0-b194-084c315be069 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network df4f6840-004b-4387-a687-683e2895186f with segmentation id not found. Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:29:28.733695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:29:28.734793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:29:28.734793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:29:28.734793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:29:28.734793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network df4f6840-004b-4387-a687-683e2895186f with segmentation id not found. Sep 27 04:29:28.734793 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:29:28.910015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a520024b-533e-4f50-9e5c-9cda26106f78 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(187901bf-c3fc-412e-bf22-0f0cf94e5382)],cidr=172.20.0.0/28,created_at=2022-09-27T04:29:28Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=adae9526-5b78-4ae5-a4c5-ed40836bb98e,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-815580073-subnet',network_id=df4f6840-004b-4387-a687-683e2895186f,project_id='53d86b6e8a8343fca03ca6d38200f23f',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:29:28Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:28.910412 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a520024b-533e-4f50-9e5c-9cda26106f78 admin admin] Publish callbacks [] for Subnet (adae9526-5b78-4ae5-a4c5-ed40836bb98e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:29.426275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0b9a1638-dbf5-4c61-8cfd-52f07869c650 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:29:29Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-df4f6840-004b-4387-a687-683e2895186f',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ab3d6ea0-0620-4743-82ab-fc092700f894,mac_address=fa:16:3e:4f:87:4f,name='',network_id=df4f6840-004b-4387-a687-683e2895186f,numa_affinity_policy=,project_id='53d86b6e8a8343fca03ca6d38200f23f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ab3d6ea0-0620-4743-82ab-fc092700f894),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:29:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:29.427695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0b9a1638-dbf5-4c61-8cfd-52f07869c650 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ab3d6ea0-0620-4743-82ab-fc092700f894), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:29.655787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0b9a1638-dbf5-4c61-8cfd-52f07869c650 None None] Resource Port ab3d6ea0-0620-4743-82ab-fc092700f894 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=ab3d6ea0-0620-4743-82ab-fc092700f894,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=ab3d6ea0-0620-4743-82ab-fc092700f894,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=ab3d6ea0-0620-4743-82ab-fc092700f894,segment=NetworkSegment(3855b0db-49a1-4957-864c-539480ffde2c),segment_id=3855b0db-49a1-4957-864c-539480ffde2c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:29.656500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0b9a1638-dbf5-4c61-8cfd-52f07869c650 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ab3d6ea0-0620-4743-82ab-fc092700f894), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:29.699714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-81ac857d-ecfb-4c61-936d-0f9e297e709c admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:29:29Z,data_plane_status=None,description='',device_id='07ade2a2-9975-4f39-ba38-5ad70098302d',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c96e44c5-6d17-4f3a-98f8-e69df467cdc3,mac_address=fa:16:3e:ee:37:94,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c96e44c5-6d17-4f3a-98f8-e69df467cdc3),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:29:29Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:29.700673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-81ac857d-ecfb-4c61-936d-0f9e297e709c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (c96e44c5-6d17-4f3a-98f8-e69df467cdc3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:29.744574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4e9d1627-0d50-4379-a59d-607f0410d9f8","insert","tapab3d6ea0-06",["set",[]],["map",[["attached-mac","fa:16:3e:4f:87:4f"],["iface-id","ab3d6ea0-0620-4743-82ab-fc092700f894"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:29.757904 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4e9d1627-0d50-4379-a59d-607f0410d9f8","old",null,["set",[]],null],["","new","tapab3d6ea0-06",33,["map",[["attached-mac","fa:16:3e:4f:87:4f"],["iface-id","ab3d6ea0-0620-4743-82ab-fc092700f894"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:29.803532 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:523 started Sep 27 04:29:29.810321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=634000000,duration_sec=1059,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:29.811188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:29.811823 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:523 - starting polling. Elapsed:0.008 Sep 27 04:29:29.814115 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:29.816138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:523 - port information retrieved. Elapsed:0.013 Sep 27 04:29:29.816471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'ab3d6ea0-0620-4743-82ab-fc092700f894', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': {'ab3d6ea0-0620-4743-82ab-fc092700f894'}, 'removed': set(), 'updated': {'ab3d6ea0-0620-4743-82ab-fc092700f894'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:29.817572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-df4f6840-004b-4387-a687-683e2895186f', 'network_id': 'df4f6840-004b-4387-a687-683e2895186f', 'port_id': 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'mac_address': 'fa:16:3e:4f:87:4f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'adae9526-5b78-4ae5-a4c5-ed40836bb98e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:29:29.819399 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: ab3d6ea0-0620-4743-82ab-fc092700f894 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:29:29.819750 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ab3d6ea0-0620-4743-82ab-fc092700f894 updated. Details: {'device': 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-df4f6840-004b-4387-a687-683e2895186f', 'network_id': 'df4f6840-004b-4387-a687-683e2895186f', 'port_id': 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'mac_address': 'fa:16:3e:4f:87:4f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'adae9526-5b78-4ae5-a4c5-ed40836bb98e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:29:29.820091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 13 as local vlan for net-id=df4f6840-004b-4387-a687-683e2895186f, seg-id=100 Sep 27 04:29:29.827003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32ec3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4196), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:29.829477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22e9b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4109)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4196}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:29.830736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapab3d6ea0-06, col_values=(('tag', 13),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:29.831170 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapab3d6ea0-06, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:29.831605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapab3d6ea0-06, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:29.836543 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapab3d6ea0-06, col_values=(('other_config', {'net_uuid': 'df4f6840-004b-4387-a687-683e2895186f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '100'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:29.848156 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22e9d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:29.848594 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:523 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 8 devices currently available. Time elapsed: 0.032 Sep 27 04:29:29.848955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:29:29.849264 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'ab3d6ea0-0620-4743-82ab-fc092700f894'} Sep 27 04:29:29.850466 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:29:29.850756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:29:29.853408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:29.909043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[95db030f-eae6-44fb-b7ca-d2f61a497ac4]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:29.909768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:523 - agent port security group processed in 0.093 Sep 27 04:29:29.910490 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for ab3d6ea0-0620-4743-82ab-fc092700f894 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:29:30.202138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['ab3d6ea0-0620-4743-82ab-fc092700f894'] and devices down [] completed. Sep 27 04:29:30.202465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:523 - ports processed. Elapsed:0.399 Sep 27 04:29:30.202811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:523 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.399 Sep 27 04:29:30.265959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port ab3d6ea0-0620-4743-82ab-fc092700f894 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:30.266444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ab3d6ea0-0620-4743-82ab-fc092700f894), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:30.634919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 9cf35c89-da17-4b43-a211-771d19ddbbf2 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:30.635486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9cf35c89-da17-4b43-a211-771d19ddbbf2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:31.519923 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a9efc48f-21d6-4a58-bf45-91de61352ee6 None None] Resource Port c96e44c5-6d17-4f3a-98f8-e69df467cdc3 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=c96e44c5-6d17-4f3a-98f8-e69df467cdc3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=c96e44c5-6d17-4f3a-98f8-e69df467cdc3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:31.520589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a9efc48f-21d6-4a58-bf45-91de61352ee6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (c96e44c5-6d17-4f3a-98f8-e69df467cdc3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:31.715966 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a9efc48f-21d6-4a58-bf45-91de61352ee6 None None] Resource Port c96e44c5-6d17-4f3a-98f8-e69df467cdc3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=c96e44c5-6d17-4f3a-98f8-e69df467cdc3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=c96e44c5-6d17-4f3a-98f8-e69df467cdc3,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=c96e44c5-6d17-4f3a-98f8-e69df467cdc3,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:31.716347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a9efc48f-21d6-4a58-bf45-91de61352ee6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (c96e44c5-6d17-4f3a-98f8-e69df467cdc3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:31.736727 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bd6b0577-794b-450f-85a2-89bb4615ba88 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:29:31Z,data_plane_status=None,description='',device_id='07ade2a2-9975-4f39-ba38-5ad70098302d',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=393bbc50-ff65-4a57-99fb-482a15b5ad7c,mac_address=fa:16:3e:df:6f:f3,name='',network_id=df4f6840-004b-4387-a687-683e2895186f,numa_affinity_policy=,project_id='53d86b6e8a8343fca03ca6d38200f23f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(393bbc50-ff65-4a57-99fb-482a15b5ad7c),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:29:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:31.737432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bd6b0577-794b-450f-85a2-89bb4615ba88 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (393bbc50-ff65-4a57-99fb-482a15b5ad7c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:31.804447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:524 started Sep 27 04:29:31.807550 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22e9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=631000000,duration_sec=1061,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:31.813457 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:31.814128 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:524 - starting polling. Elapsed:0.010 Sep 27 04:29:31.820425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:31.822620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:524 - port information retrieved. Elapsed:0.018 Sep 27 04:29:31.823531 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'ab3d6ea0-0620-4743-82ab-fc092700f894', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': set(), 'removed': set(), 'updated': {'ab3d6ea0-0620-4743-82ab-fc092700f894'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:31.824189 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-df4f6840-004b-4387-a687-683e2895186f', 'network_id': 'df4f6840-004b-4387-a687-683e2895186f', 'port_id': 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'mac_address': 'fa:16:3e:4f:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'adae9526-5b78-4ae5-a4c5-ed40836bb98e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:29:31.827881 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: ab3d6ea0-0620-4743-82ab-fc092700f894 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:29:31.828275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ab3d6ea0-0620-4743-82ab-fc092700f894 updated. Details: {'device': 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-df4f6840-004b-4387-a687-683e2895186f', 'network_id': 'df4f6840-004b-4387-a687-683e2895186f', 'port_id': 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'mac_address': 'fa:16:3e:4f:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'adae9526-5b78-4ae5-a4c5-ed40836bb98e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Sep 27 04:29:31.829643 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapab3d6ea0-06, col_values=(('tag', 13),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:31.830160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapab3d6ea0-06, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:31.830726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapab3d6ea0-06, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:31.831169 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:29:31.832607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapab3d6ea0-06, col_values=(('other_config', {'net_uuid': 'df4f6840-004b-4387-a687-683e2895186f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '100', 'tag': '13'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:31.834026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:29:31.837043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22ea1,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:31.837399 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:524 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 8 devices currently available. Time elapsed: 0.014 Sep 27 04:29:31.838766 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:29:31.839068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:29:31.840223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:29:31.840511 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:29:31.843228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:31.884002 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eacf35-0893-48e0-9e87-e5079d03c53d]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:31.884835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:524 - agent port security group processed in 0.061 Sep 27 04:29:31.885504 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for ab3d6ea0-0620-4743-82ab-fc092700f894 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:29:32.190609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bd6b0577-794b-450f-85a2-89bb4615ba88 admin admin] Received resource Port update without any changes: 393bbc50-ff65-4a57-99fb-482a15b5ad7c {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:29:32.297521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['ab3d6ea0-0620-4743-82ab-fc092700f894'] and devices down [] completed. Sep 27 04:29:32.301281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:524 - ports processed. Elapsed:0.494 Sep 27 04:29:32.302013 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:524 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.498 Sep 27 04:29:32.456146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["94550136-c4b8-4877-b0c2-3f100c9585de","insert","qg-c96e44c5-6d",["set",[]],["map",[["attached-mac","fa:16:3e:ee:37:94"],["iface-id","c96e44c5-6d17-4f3a-98f8-e69df467cdc3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:32.481223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["94550136-c4b8-4877-b0c2-3f100c9585de","old",null,["set",[]],null],["","new","qg-c96e44c5-6d",34,["map",[["attached-mac","fa:16:3e:ee:37:94"],["iface-id","c96e44c5-6d17-4f3a-98f8-e69df467cdc3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:33.285537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:29:33Z,description='Default security group',id=20bb106a-15a7-46e5-a255-a2be5cc14a4f,is_default=True,name='default',project_id='8069df7a2e984db0ac8925e1f0c242d8',revision_number=1,rules=[SecurityGroupRule(2f4ceb1b-a11d-4f36-9147-da70e9c0a08f),SecurityGroupRule(51a67d50-8ef1-4b31-b902-537b4a7481a4),SecurityGroupRule(ad28742f-8c0f-4b8c-ac55-29426b566d0c),SecurityGroupRule(b8ecb1fc-2012-4004-b3d0-15e18d7d2f47)],shared=False,stateful=True,updated_at=2022-09-27T04:29:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:33.286408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (20bb106a-15a7-46e5-a255-a2be5cc14a4f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:33.287250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:33Z,description=,direction='egress',ethertype='IPv6',id=2f4ceb1b-a11d-4f36-9147-da70e9c0a08f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8069df7a2e984db0ac8925e1f0c242d8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=20bb106a-15a7-46e5-a255-a2be5cc14a4f,updated_at=2022-09-27T04:29:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:33.288163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2f4ceb1b-a11d-4f36-9147-da70e9c0a08f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:33.288928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Security group rule updated ['20bb106a-15a7-46e5-a255-a2be5cc14a4f'] Sep 27 04:29:33.289974 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:33Z,description=,direction='egress',ethertype='IPv4',id=51a67d50-8ef1-4b31-b902-537b4a7481a4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8069df7a2e984db0ac8925e1f0c242d8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=20bb106a-15a7-46e5-a255-a2be5cc14a4f,updated_at=2022-09-27T04:29:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:33.290585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (51a67d50-8ef1-4b31-b902-537b4a7481a4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:33.291254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Security group rule updated ['20bb106a-15a7-46e5-a255-a2be5cc14a4f'] Sep 27 04:29:33.292296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:33Z,description=,direction='ingress',ethertype='IPv6',id=ad28742f-8c0f-4b8c-ac55-29426b566d0c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8069df7a2e984db0ac8925e1f0c242d8',protocol=,remote_address_group_id=,remote_group_id=20bb106a-15a7-46e5-a255-a2be5cc14a4f,remote_ip_prefix=,revision_number=0,security_group_id=20bb106a-15a7-46e5-a255-a2be5cc14a4f,updated_at=2022-09-27T04:29:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:33.293015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (ad28742f-8c0f-4b8c-ac55-29426b566d0c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:33.293527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Security group rule updated ['20bb106a-15a7-46e5-a255-a2be5cc14a4f'] Sep 27 04:29:33.294810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:33Z,description=,direction='ingress',ethertype='IPv4',id=b8ecb1fc-2012-4004-b3d0-15e18d7d2f47,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8069df7a2e984db0ac8925e1f0c242d8',protocol=,remote_address_group_id=,remote_group_id=20bb106a-15a7-46e5-a255-a2be5cc14a4f,remote_ip_prefix=,revision_number=0,security_group_id=20bb106a-15a7-46e5-a255-a2be5cc14a4f,updated_at=2022-09-27T04:29:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:33.295512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b8ecb1fc-2012-4004-b3d0-15e18d7d2f47), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:33.296111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Security group rule updated ['20bb106a-15a7-46e5-a255-a2be5cc14a4f'] Sep 27 04:29:33.435718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:29:33Z,description='',dns_domain=None,id=ff8958a9-1d15-4a33-98bb-91961388fca3,mtu=1500,name='tempest-TestVolumeBootPattern-1299133401-network',project_id='8069df7a2e984db0ac8925e1f0c242d8',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(ff8958a9-1d15-4a33-98bb-91961388fca3),segments=[NetworkSegment(1f5f70c2-b521-4468-aada-3bc551b798e3)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:29:33Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:33.436106 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (ff8958a9-1d15-4a33-98bb-91961388fca3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-3a4e974b-0a59-47f0-a296-c3fd47eacebb admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ff8958a9-1d15-4a33-98bb-91961388fca3 with segmentation id not found. Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:29:33.514501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:29:33.515598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:29:33.515598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:29:33.515598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:29:33.515598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ff8958a9-1d15-4a33-98bb-91961388fca3 with segmentation id not found. Sep 27 04:29:33.515598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:29:33.805064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:525 started Sep 27 04:29:33.807620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ea3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=632000000,duration_sec=1063,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:33.808269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:33.808895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:525 - starting polling. Elapsed:0.004 Sep 27 04:29:33.810675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:33.812682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:525 - port information retrieved. Elapsed:0.008 Sep 27 04:29:33.813011 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'ab3d6ea0-0620-4743-82ab-fc092700f894', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': {'c96e44c5-6d17-4f3a-98f8-e69df467cdc3'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:33.813769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', 'device_id': '07ade2a2-9975-4f39-ba38-5ad70098302d', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', 'mac_address': 'fa:16:3e:ee:37:94', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.254'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:29:33.815751 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: c96e44c5-6d17-4f3a-98f8-e69df467cdc3 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:29:33.816081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port c96e44c5-6d17-4f3a-98f8-e69df467cdc3 updated. Details: {'device': 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', 'device_id': '07ade2a2-9975-4f39-ba38-5ad70098302d', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', 'mac_address': 'fa:16:3e:ee:37:94', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.254'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:29:33.817024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c96e44c5-6d, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:33.817443 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-c96e44c5-6d, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:33.818067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-c96e44c5-6d, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:33.823633 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c96e44c5-6d, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:33.832217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22ea5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:33.833194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:525 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.019 Sep 27 04:29:33.833625 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:29:33.833951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'c96e44c5-6d17-4f3a-98f8-e69df467cdc3'} Sep 27 04:29:33.835147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:29:33.835430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:29:33.838257 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:33.894315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d9d823-c302-4e0b-a269-4c0772cca719]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:33.894949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:525 - agent port security group processed in 0.082 Sep 27 04:29:33.896250 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for c96e44c5-6d17-4f3a-98f8-e69df467cdc3 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:29:34.062722 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['c96e44c5-6d17-4f3a-98f8-e69df467cdc3'] and devices down [] completed. Sep 27 04:29:34.063223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:525 - ports processed. Elapsed:0.258 Sep 27 04:29:34.063689 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:525 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.259 Sep 27 04:29:34.095238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-61c2bba5-9f36-4aca-9cae-72248b01181f admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(8e689b48-a4f2-459a-bf73-7ae3b0104c2d)],cidr=172.20.0.0/28,created_at=2022-09-27T04:29:33Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=aac67899-dc5a-496e-bf8d-d7385b65acc1,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-1299133401-subnet',network_id=ff8958a9-1d15-4a33-98bb-91961388fca3,project_id='8069df7a2e984db0ac8925e1f0c242d8',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:29:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:34.095889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-61c2bba5-9f36-4aca-9cae-72248b01181f admin admin] Publish callbacks [] for Subnet (aac67899-dc5a-496e-bf8d-d7385b65acc1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:34.126159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port c96e44c5-6d17-4f3a-98f8-e69df467cdc3 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=c96e44c5-6d17-4f3a-98f8-e69df467cdc3,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=c96e44c5-6d17-4f3a-98f8-e69df467cdc3,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:34.126844 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (c96e44c5-6d17-4f3a-98f8-e69df467cdc3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:34.708782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3717384b-d940-463e-8879-9f5271b20476 None None] Resource Port 393bbc50-ff65-4a57-99fb-482a15b5ad7c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=393bbc50-ff65-4a57-99fb-482a15b5ad7c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=393bbc50-ff65-4a57-99fb-482a15b5ad7c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:34.709924 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3717384b-d940-463e-8879-9f5271b20476 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (393bbc50-ff65-4a57-99fb-482a15b5ad7c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:34.945754 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3717384b-d940-463e-8879-9f5271b20476 None None] Resource Port 393bbc50-ff65-4a57-99fb-482a15b5ad7c updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=393bbc50-ff65-4a57-99fb-482a15b5ad7c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=393bbc50-ff65-4a57-99fb-482a15b5ad7c,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=393bbc50-ff65-4a57-99fb-482a15b5ad7c,segment=NetworkSegment(3855b0db-49a1-4957-864c-539480ffde2c),segment_id=3855b0db-49a1-4957-864c-539480ffde2c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:34.947719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3717384b-d940-463e-8879-9f5271b20476 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (393bbc50-ff65-4a57-99fb-482a15b5ad7c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:35.058697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a429d566-bd89-4fec-9e46-9108fb48567f None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:29:34Z,data_plane_status=None,description='',device_id='dhcp977886c5-f3aa-5b76-a131-51301725c052-ff8958a9-1d15-4a33-98bb-91961388fca3',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6ee36b09-9938-4ec7-97df-f1b955bddb94,mac_address=fa:16:3e:07:16:4f,name='',network_id=ff8958a9-1d15-4a33-98bb-91961388fca3,numa_affinity_policy=,project_id='8069df7a2e984db0ac8925e1f0c242d8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6ee36b09-9938-4ec7-97df-f1b955bddb94),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:29:34Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:35.060718 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a429d566-bd89-4fec-9e46-9108fb48567f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6ee36b09-9938-4ec7-97df-f1b955bddb94), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:35.268624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a53cd177-2dd9-4db1-8cad-88f285e8f78c","insert","qr-393bbc50-ff",["set",[]],["map",[["attached-mac","fa:16:3e:df:6f:f3"],["iface-id","393bbc50-ff65-4a57-99fb-482a15b5ad7c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:35.319686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a53cd177-2dd9-4db1-8cad-88f285e8f78c","old",null,["set",[]],null],["","new","qr-393bbc50-ff",35,["map",[["attached-mac","fa:16:3e:df:6f:f3"],["iface-id","393bbc50-ff65-4a57-99fb-482a15b5ad7c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:35.638062 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b974a847-060b-4da2-aafb-312c91d4755c None None] Resource Port 393bbc50-ff65-4a57-99fb-482a15b5ad7c updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:35.639046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b974a847-060b-4da2-aafb-312c91d4755c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (393bbc50-ff65-4a57-99fb-482a15b5ad7c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:35.806094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:526 started Sep 27 04:29:35.810664 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ea7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=634000000,duration_sec=1065,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:35.812269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:35.813430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:526 - starting polling. Elapsed:0.008 Sep 27 04:29:35.815691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:35.822668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:526 - port information retrieved. Elapsed:0.017 Sep 27 04:29:35.823004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'ab3d6ea0-0620-4743-82ab-fc092700f894', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', '393bbc50-ff65-4a57-99fb-482a15b5ad7c', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': {'393bbc50-ff65-4a57-99fb-482a15b5ad7c'}, 'removed': set(), 'updated': {'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', '393bbc50-ff65-4a57-99fb-482a15b5ad7c'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:35.824245 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', 'device_id': '07ade2a2-9975-4f39-ba38-5ad70098302d', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', 'mac_address': 'fa:16:3e:ee:37:94', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.254'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:29:35.824879 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '393bbc50-ff65-4a57-99fb-482a15b5ad7c', 'device_id': '07ade2a2-9975-4f39-ba38-5ad70098302d', 'network_id': 'df4f6840-004b-4387-a687-683e2895186f', 'port_id': '393bbc50-ff65-4a57-99fb-482a15b5ad7c', 'mac_address': 'fa:16:3e:df:6f:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'adae9526-5b78-4ae5-a4c5-ed40836bb98e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:29:35.827410 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: c96e44c5-6d17-4f3a-98f8-e69df467cdc3 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:29:35.827925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port c96e44c5-6d17-4f3a-98f8-e69df467cdc3 updated. Details: {'device': 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', 'device_id': '07ade2a2-9975-4f39-ba38-5ad70098302d', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', 'mac_address': 'fa:16:3e:ee:37:94', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.254'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:29:35.829880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c96e44c5-6d, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:35.830307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-c96e44c5-6d, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:35.830704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-c96e44c5-6d, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:35.831147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:29:35.831893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c96e44c5-6d, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:35.832530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:29:35.839782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22ea9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:35.840126 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 393bbc50-ff65-4a57-99fb-482a15b5ad7c {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:29:35.840629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 393bbc50-ff65-4a57-99fb-482a15b5ad7c updated. Details: {'device': '393bbc50-ff65-4a57-99fb-482a15b5ad7c', 'device_id': '07ade2a2-9975-4f39-ba38-5ad70098302d', 'network_id': 'df4f6840-004b-4387-a687-683e2895186f', 'port_id': '393bbc50-ff65-4a57-99fb-482a15b5ad7c', 'mac_address': 'fa:16:3e:df:6f:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'adae9526-5b78-4ae5-a4c5-ed40836bb98e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Sep 27 04:29:35.841768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-393bbc50-ff, col_values=(('tag', 13),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:35.842364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-393bbc50-ff, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:35.842965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-393bbc50-ff, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:35.851303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-393bbc50-ff, col_values=(('other_config', {'net_uuid': 'df4f6840-004b-4387-a687-683e2895186f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '100'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:35.865196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4ab76367-c8f2-4f37-99bd-5229f0d942a6 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:29:35Z,data_plane_status=None,description='',device_id='3a57b971-3f52-4835-99a8-124d65408ffd',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=25a54548-54d9-441f-b9e5-01972934299d,mac_address=fa:16:3e:3a:dc:39,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(25a54548-54d9-441f-b9e5-01972934299d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:29:35Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:35.865498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4ab76367-c8f2-4f37-99bd-5229f0d942a6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (25a54548-54d9-441f-b9e5-01972934299d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:35.874899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a429d566-bd89-4fec-9e46-9108fb48567f None None] Resource Port 6ee36b09-9938-4ec7-97df-f1b955bddb94 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=6ee36b09-9938-4ec7-97df-f1b955bddb94,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=6ee36b09-9938-4ec7-97df-f1b955bddb94,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=6ee36b09-9938-4ec7-97df-f1b955bddb94,segment=NetworkSegment(1f5f70c2-b521-4468-aada-3bc551b798e3),segment_id=1f5f70c2-b521-4468-aada-3bc551b798e3)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:35.875260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a429d566-bd89-4fec-9e46-9108fb48567f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6ee36b09-9938-4ec7-97df-f1b955bddb94), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:35.879949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22eab,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:35.880555 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:526 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 10 devices currently available. Time elapsed: 0.057 Sep 27 04:29:35.880972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:29:35.881276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'393bbc50-ff65-4a57-99fb-482a15b5ad7c'} Sep 27 04:29:35.883014 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:29:35.883298 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:29:35.887225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:35.955639 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e350fc-cd4b-4465-80c1-f0deadd25e61]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:35.956287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:29:35.956572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:29:35.961345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:29:35.961345 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:29:35.962113 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:36.018556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e752eae0-5adc-4bf6-915f-20413121faf5","insert","tap6ee36b09-99",["set",[]],["map",[["attached-mac","fa:16:3e:07:16:4f"],["iface-id","6ee36b09-9938-4ec7-97df-f1b955bddb94"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:36.058201 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e752eae0-5adc-4bf6-915f-20413121faf5","old",null,["set",[]],null],["","new","tap6ee36b09-99",36,["map",[["attached-mac","fa:16:3e:07:16:4f"],["iface-id","6ee36b09-9938-4ec7-97df-f1b955bddb94"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:36.058712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6176dad-4553-4c75-b4a3-1cb03d7ddf68]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:36.065495 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:526 - agent port security group processed in 0.242 Sep 27 04:29:36.066273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for c96e44c5-6d17-4f3a-98f8-e69df467cdc3 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:29:36.066577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 393bbc50-ff65-4a57-99fb-482a15b5ad7c to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:29:36.441630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['c96e44c5-6d17-4f3a-98f8-e69df467cdc3', '393bbc50-ff65-4a57-99fb-482a15b5ad7c'] and devices down [] completed. Sep 27 04:29:36.442578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:526 - ports processed. Elapsed:0.636 Sep 27 04:29:36.442990 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:526 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.637 Sep 27 04:29:37.559135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-12100978-62ef-4f23-a18d-0fe90b650280 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:29:37Z,data_plane_status=None,description='',device_id='3a57b971-3f52-4835-99a8-124d65408ffd',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6e8b23b0-bc61-4571-9a21-75bb81bcfa43,mac_address=fa:16:3e:7e:d3:6e,name='',network_id=ff8958a9-1d15-4a33-98bb-91961388fca3,numa_affinity_policy=,project_id='8069df7a2e984db0ac8925e1f0c242d8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6e8b23b0-bc61-4571-9a21-75bb81bcfa43),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:29:37Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:37.561325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-12100978-62ef-4f23-a18d-0fe90b650280 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6e8b23b0-bc61-4571-9a21-75bb81bcfa43), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:37.574781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-82f08691-5300-4796-8a45-cd8a53d6a76a None None] Resource Port 6ee36b09-9938-4ec7-97df-f1b955bddb94 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:37.577587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-82f08691-5300-4796-8a45-cd8a53d6a76a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6ee36b09-9938-4ec7-97df-f1b955bddb94), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:37.807587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:527 started Sep 27 04:29:37.810568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ead,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=635000000,duration_sec=1067,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:37.811234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:37.811777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:527 - starting polling. Elapsed:0.004 Sep 27 04:29:37.814210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:37.816804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:527 - port information retrieved. Elapsed:0.009 Sep 27 04:29:37.817398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'ab3d6ea0-0620-4743-82ab-fc092700f894', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', '393bbc50-ff65-4a57-99fb-482a15b5ad7c', '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': {'6ee36b09-9938-4ec7-97df-f1b955bddb94'}, 'removed': set(), 'updated': {'6ee36b09-9938-4ec7-97df-f1b955bddb94'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:37.818088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-ff8958a9-1d15-4a33-98bb-91961388fca3', 'network_id': 'ff8958a9-1d15-4a33-98bb-91961388fca3', 'port_id': '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'mac_address': 'fa:16:3e:07:16:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'aac67899-dc5a-496e-bf8d-d7385b65acc1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:29:37.820396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 6ee36b09-9938-4ec7-97df-f1b955bddb94 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:29:37.820810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 6ee36b09-9938-4ec7-97df-f1b955bddb94 updated. Details: {'device': '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'device_id': 'dhcp977886c5-f3aa-5b76-a131-51301725c052-ff8958a9-1d15-4a33-98bb-91961388fca3', 'network_id': 'ff8958a9-1d15-4a33-98bb-91961388fca3', 'port_id': '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'mac_address': 'fa:16:3e:07:16:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'aac67899-dc5a-496e-bf8d-d7385b65acc1', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 27 04:29:37.821241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Assigning 14 as local vlan for net-id=ff8958a9-1d15-4a33-98bb-91961388fca3, seg-id=114 Sep 27 04:29:37.825235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x6ec32ec5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=8472736809372409585,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4210), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:37.827556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xbc22eaf,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4110)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4210}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:37.828614 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6ee36b09-99, col_values=(('tag', 14),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:37.829114 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap6ee36b09-99, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:37.829799 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap6ee36b09-99, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:37.836651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6ee36b09-99, col_values=(('other_config', {'net_uuid': 'ff8958a9-1d15-4a33-98bb-91961388fca3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '114'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:37.849420 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22eb1,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:37.850471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:527 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 11 devices currently available. Time elapsed: 0.033 Sep 27 04:29:37.850951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 1 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:29:37.851136 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'6ee36b09-9938-4ec7-97df-f1b955bddb94'} Sep 27 04:29:37.853077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:29:37.853077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:29:37.856912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:37.899850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c220ed0d-a7ac-4f4e-9064-bbeeb33dc868]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:37.900690 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:527 - agent port security group processed in 0.083 Sep 27 04:29:37.901290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 6ee36b09-9938-4ec7-97df-f1b955bddb94 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:29:38.002858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-12100978-62ef-4f23-a18d-0fe90b650280 admin admin] Received resource Port update without any changes: 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 27 04:29:38.039782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-779c0137-77e9-403f-bee8-bb984b55918c None None] Resource Port 25a54548-54d9-441f-b9e5-01972934299d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=25a54548-54d9-441f-b9e5-01972934299d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=25a54548-54d9-441f-b9e5-01972934299d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:38.040289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-779c0137-77e9-403f-bee8-bb984b55918c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (25a54548-54d9-441f-b9e5-01972934299d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:38.256566 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['6ee36b09-9938-4ec7-97df-f1b955bddb94'] and devices down [] completed. Sep 27 04:29:38.257288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:527 - ports processed. Elapsed:0.450 Sep 27 04:29:38.258117 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:527 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.450 Sep 27 04:29:38.363172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-779c0137-77e9-403f-bee8-bb984b55918c None None] Resource Port 25a54548-54d9-441f-b9e5-01972934299d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=25a54548-54d9-441f-b9e5-01972934299d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=25a54548-54d9-441f-b9e5-01972934299d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=25a54548-54d9-441f-b9e5-01972934299d,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:38.363892 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-779c0137-77e9-403f-bee8-bb984b55918c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (25a54548-54d9-441f-b9e5-01972934299d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:38.810280 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8590a171-9a13-486b-98ec-76232ace5a67","insert","qr-6e8b23b0-bc",["set",[]],["map",[["attached-mac","fa:16:3e:7e:d3:6e"],["iface-id","6e8b23b0-bc61-4571-9a21-75bb81bcfa43"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:38.820193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8590a171-9a13-486b-98ec-76232ace5a67","old",null,["set",[]],null],["","new","qr-6e8b23b0-bc",37,["map",[["attached-mac","fa:16:3e:7e:d3:6e"],["iface-id","6e8b23b0-bc61-4571-9a21-75bb81bcfa43"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:38.893451 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d45a1e51-ac46-45a2-add2-b69e6aafe09b tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:29:38Z,description='tempest-secgroup-smoke-1621255540 description',id=dc8aeeb6-4f41-4b60-b98c-998d780399e1,is_default=False,name='tempest-secgroup-smoke-1621255540',project_id='53d86b6e8a8343fca03ca6d38200f23f',revision_number=1,rules=[SecurityGroupRule(333df58e-cbee-4278-b1e8-b254b7172aa7),SecurityGroupRule(77db1260-c534-4ab7-8a3b-120d03485bb7)],shared=False,stateful=True,updated_at=2022-09-27T04:29:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:38.893888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d45a1e51-ac46-45a2-add2-b69e6aafe09b tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (dc8aeeb6-4f41-4b60-b98c-998d780399e1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:38.895941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d45a1e51-ac46-45a2-add2-b69e6aafe09b tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:38Z,description=,direction='egress',ethertype='IPv6',id=333df58e-cbee-4278-b1e8-b254b7172aa7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc8aeeb6-4f41-4b60-b98c-998d780399e1,updated_at=2022-09-27T04:29:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:38.896475 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d45a1e51-ac46-45a2-add2-b69e6aafe09b tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (333df58e-cbee-4278-b1e8-b254b7172aa7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:38.896995 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d45a1e51-ac46-45a2-add2-b69e6aafe09b tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:29:38.897919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d45a1e51-ac46-45a2-add2-b69e6aafe09b tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:38Z,description=,direction='egress',ethertype='IPv4',id=77db1260-c534-4ab7-8a3b-120d03485bb7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc8aeeb6-4f41-4b60-b98c-998d780399e1,updated_at=2022-09-27T04:29:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:38.898586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d45a1e51-ac46-45a2-add2-b69e6aafe09b tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (77db1260-c534-4ab7-8a3b-120d03485bb7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:38.899071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d45a1e51-ac46-45a2-add2-b69e6aafe09b tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:29:39.018246 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c8586010-bfed-4fef-b2dd-8f6151746c76 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:38Z,description='',direction='ingress',ethertype='IPv4',id=f51ffdda-15a6-4dcd-8145-fc7158f6ba19,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc8aeeb6-4f41-4b60-b98c-998d780399e1,updated_at=2022-09-27T04:29:38Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:39.018246 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c8586010-bfed-4fef-b2dd-8f6151746c76 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f51ffdda-15a6-4dcd-8145-fc7158f6ba19), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:39.018246 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c8586010-bfed-4fef-b2dd-8f6151746c76 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:29:39.140526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30c6b6cc-59ad-4e4a-8f93-bffb6b2144eb tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:39Z,description='',direction='egress',ethertype='IPv4',id=b10426d5-0aab-4f92-a0e8-94801206a991,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc8aeeb6-4f41-4b60-b98c-998d780399e1,updated_at=2022-09-27T04:29:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:39.140917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30c6b6cc-59ad-4e4a-8f93-bffb6b2144eb tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b10426d5-0aab-4f92-a0e8-94801206a991), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:39.141472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-30c6b6cc-59ad-4e4a-8f93-bffb6b2144eb tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:29:39.245302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["95bc50b1-bdd6-46f8-8af5-212afb73bc70","insert","qg-25a54548-54",["set",[]],["map",[["attached-mac","fa:16:3e:3a:dc:39"],["iface-id","25a54548-54d9-441f-b9e5-01972934299d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:39.266057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["95bc50b1-bdd6-46f8-8af5-212afb73bc70","old",null,["set",[]],null],["","new","qg-25a54548-54",38,["map",[["attached-mac","fa:16:3e:3a:dc:39"],["iface-id","25a54548-54d9-441f-b9e5-01972934299d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:29:39.306545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f45ca2cb-d370-4ed7-8e0f-ce5c4401a291 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:39Z,description='',direction='ingress',ethertype='IPv4',id=432716f0-3eab-493d-8f66-aa25d29eccc8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc8aeeb6-4f41-4b60-b98c-998d780399e1,updated_at=2022-09-27T04:29:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:39.306933 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f45ca2cb-d370-4ed7-8e0f-ce5c4401a291 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (432716f0-3eab-493d-8f66-aa25d29eccc8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:39.307279 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f45ca2cb-d370-4ed7-8e0f-ce5c4401a291 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:29:39.448729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-eae7dcc8-0bf0-43d8-9078-bd445d1568c4 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:39Z,description='',direction='egress',ethertype='IPv4',id=bd059e0c-506d-4534-93ea-0d369f925e1f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc8aeeb6-4f41-4b60-b98c-998d780399e1,updated_at=2022-09-27T04:29:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:39.449120 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-eae7dcc8-0bf0-43d8-9078-bd445d1568c4 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (bd059e0c-506d-4534-93ea-0d369f925e1f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:39.449468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-eae7dcc8-0bf0-43d8-9078-bd445d1568c4 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:29:39.579727 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1f73f503-05a4-416c-b987-df8aace175ec tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:39Z,description='',direction='ingress',ethertype='IPv6',id=696bc1a5-554a-43e0-b016-630a1b6c4101,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc8aeeb6-4f41-4b60-b98c-998d780399e1,updated_at=2022-09-27T04:29:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:39.580349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1f73f503-05a4-416c-b987-df8aace175ec tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (696bc1a5-554a-43e0-b016-630a1b6c4101), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:39.580761 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1f73f503-05a4-416c-b987-df8aace175ec tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:29:39.718453 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6dad69e8-dfe6-4f51-9f78-d7d53e89f3b1 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:29:39Z,description='',direction='egress',ethertype='IPv6',id=b6041ffc-164f-4bef-9176-52f875aa42cc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='53d86b6e8a8343fca03ca6d38200f23f',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc8aeeb6-4f41-4b60-b98c-998d780399e1,updated_at=2022-09-27T04:29:39Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:39.718969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6dad69e8-dfe6-4f51-9f78-d7d53e89f3b1 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b6041ffc-164f-4bef-9176-52f875aa42cc), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:39.719507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6dad69e8-dfe6-4f51-9f78-d7d53e89f3b1 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:29:39.808874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:528 started Sep 27 04:29:39.811552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22eb3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=636000000,duration_sec=1069,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:39.812210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:39.813022 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:528 - starting polling. Elapsed:0.004 Sep 27 04:29:39.815958 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:39.818928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:528 - port information retrieved. Elapsed:0.010 Sep 27 04:29:39.819435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'ab3d6ea0-0620-4743-82ab-fc092700f894', '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', '393bbc50-ff65-4a57-99fb-482a15b5ad7c', '25a54548-54d9-441f-b9e5-01972934299d', '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': {'25a54548-54d9-441f-b9e5-01972934299d', '6e8b23b0-bc61-4571-9a21-75bb81bcfa43'}, 'removed': set(), 'updated': {'25a54548-54d9-441f-b9e5-01972934299d'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:39.820532 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '25a54548-54d9-441f-b9e5-01972934299d', 'device_id': '3a57b971-3f52-4835-99a8-124d65408ffd', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '25a54548-54d9-441f-b9e5-01972934299d', 'mac_address': 'fa:16:3e:3a:dc:39', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.18'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:29:39.822220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:29:37Z,data_plane_status=None,description='',device_id='3a57b971-3f52-4835-99a8-124d65408ffd',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6e8b23b0-bc61-4571-9a21-75bb81bcfa43,mac_address=fa:16:3e:7e:d3:6e,name='',network_id=ff8958a9-1d15-4a33-98bb-91961388fca3,numa_affinity_policy=,project_id='8069df7a2e984db0ac8925e1f0c242d8',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(6e8b23b0-bc61-4571-9a21-75bb81bcfa43),security_group_ids=set([]),status='DOWN',updated_at=2022-09-27T04:29:37Z) is not bound. Sep 27 04:29:39.825399 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 25a54548-54d9-441f-b9e5-01972934299d {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:29:39.826002 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 25a54548-54d9-441f-b9e5-01972934299d updated. Details: {'device': '25a54548-54d9-441f-b9e5-01972934299d', 'device_id': '3a57b971-3f52-4835-99a8-124d65408ffd', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '25a54548-54d9-441f-b9e5-01972934299d', 'mac_address': 'fa:16:3e:3a:dc:39', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.18'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:29:39.827177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-25a54548-54, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:39.827779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-25a54548-54, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:39.828362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-25a54548-54, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:39.833209 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-25a54548-54, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:39.841507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22eb5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:39.841685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:29:39.841915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Device 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 not defined on plugin or binding failed Sep 27 04:29:39.842552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:528 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.022 Sep 27 04:29:39.843022 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing device filters for 2 new devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 27 04:29:39.843198 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Preparing filters for devices {'25a54548-54d9-441f-b9e5-01972934299d', '6e8b23b0-bc61-4571-9a21-75bb81bcfa43'} Sep 27 04:29:39.845023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:29:39.845318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:29:39.849247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:39.905953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2c0eee-4b0e-4f78-bea7-41fac7d2c3c0]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:39.906662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:528 - agent port security group processed in 0.086 Sep 27 04:29:39.907496 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 25a54548-54d9-441f-b9e5-01972934299d to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:29:40.069693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['25a54548-54d9-441f-b9e5-01972934299d'] and devices down [] completed. Sep 27 04:29:40.070397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:528 - ports processed. Elapsed:0.262 Sep 27 04:29:40.071243 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:528 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 1, 'removed': 0}}. Elapsed:0.262 Sep 27 04:29:40.123561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Resource Port 25a54548-54d9-441f-b9e5-01972934299d updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=25a54548-54d9-441f-b9e5-01972934299d,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=25a54548-54d9-441f-b9e5-01972934299d,segment=NetworkSegment(458173e0-a334-422f-a9db-e4c60ba44888),segment_id=458173e0-a334-422f-a9db-e4c60ba44888)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:40.123955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e50dadac-db26-40f9-b699-a1620d7cc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (25a54548-54d9-441f-b9e5-01972934299d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:41.810819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:529 started Sep 27 04:29:41.813438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22eb7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=638000000,duration_sec=1071,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:41.814132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:41.814548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:529 - starting polling. Elapsed:0.004 Sep 27 04:29:41.816697 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:41.819855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:529 - port information retrieved. Elapsed:0.009 Sep 27 04:29:41.820266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'ab3d6ea0-0620-4743-82ab-fc092700f894', '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', '393bbc50-ff65-4a57-99fb-482a15b5ad7c', '25a54548-54d9-441f-b9e5-01972934299d', '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': set(), 'removed': set(), 'updated': {'25a54548-54d9-441f-b9e5-01972934299d'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:41.820938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '25a54548-54d9-441f-b9e5-01972934299d', 'device_id': '3a57b971-3f52-4835-99a8-124d65408ffd', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '25a54548-54d9-441f-b9e5-01972934299d', 'mac_address': 'fa:16:3e:3a:dc:39', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.18'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:29:41.823914 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 25a54548-54d9-441f-b9e5-01972934299d {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:29:41.824244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 25a54548-54d9-441f-b9e5-01972934299d updated. Details: {'device': '25a54548-54d9-441f-b9e5-01972934299d', 'device_id': '3a57b971-3f52-4835-99a8-124d65408ffd', 'network_id': '4c2326fb-b4db-42c7-9331-4377c9818745', 'port_id': '25a54548-54d9-441f-b9e5-01972934299d', 'mac_address': 'fa:16:3e:3a:dc:39', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '65648eee-291b-4b8a-95c0-f3ca12df09c9', 'ip_address': '172.27.0.18'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 27 04:29:41.825239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-25a54548-54, col_values=(('tag', 2),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:41.825673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-25a54548-54, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:41.826096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-25a54548-54, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:41.826542 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:29:41.827296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-25a54548-54, col_values=(('other_config', {'net_uuid': '4c2326fb-b4db-42c7-9331-4377c9818745', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:41.827936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 27 04:29:41.830371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22eb9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:41.830617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:529 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.010 Sep 27 04:29:41.830971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:29:41.831263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:29:41.832419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:29:41.832700 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:29:41.835932 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:41.873507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dbdf47-fd48-435f-9595-d300b65a2e4f]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:41.874194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:529 - agent port security group processed in 0.054 Sep 27 04:29:41.874917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 25a54548-54d9-441f-b9e5-01972934299d to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:29:42.037477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['25a54548-54d9-441f-b9e5-01972934299d'] and devices down [] completed. Sep 27 04:29:42.037833 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:529 - ports processed. Elapsed:0.227 Sep 27 04:29:42.038180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:529 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.228 Sep 27 04:29:42.115382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a56ea390-b520-4553-a86d-cdc3425204fe None None] Resource Port 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=6e8b23b0-bc61-4571-9a21-75bb81bcfa43,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=6e8b23b0-bc61-4571-9a21-75bb81bcfa43,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:42.115951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a56ea390-b520-4553-a86d-cdc3425204fe None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6e8b23b0-bc61-4571-9a21-75bb81bcfa43), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:42.364779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a56ea390-b520-4553-a86d-cdc3425204fe None None] Resource Port 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=6e8b23b0-bc61-4571-9a21-75bb81bcfa43,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-859186-3-iscsi',port_id=6e8b23b0-bc61-4571-9a21-75bb81bcfa43,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-859186-3-iscsi',level=0,port_id=6e8b23b0-bc61-4571-9a21-75bb81bcfa43,segment=NetworkSegment(1f5f70c2-b521-4468-aada-3bc551b798e3),segment_id=1f5f70c2-b521-4468-aada-3bc551b798e3)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:42.365180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a56ea390-b520-4553-a86d-cdc3425204fe None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6e8b23b0-bc61-4571-9a21-75bb81bcfa43), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:42.674961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ef7cdc65-e0cf-4b65-9d80-f41d95ec1b51 None None] Resource Port 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:42.675343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ef7cdc65-e0cf-4b65-9d80-f41d95ec1b51 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6e8b23b0-bc61-4571-9a21-75bb81bcfa43), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:43.811617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:530 started Sep 27 04:29:43.814109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ebb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=638000000,duration_sec=1073,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:43.814691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:43.815083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:530 - starting polling. Elapsed:0.004 Sep 27 04:29:43.817145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:43.819769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:530 - port information retrieved. Elapsed:0.008 Sep 27 04:29:43.820111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'ab3d6ea0-0620-4743-82ab-fc092700f894', '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', '393bbc50-ff65-4a57-99fb-482a15b5ad7c', '25a54548-54d9-441f-b9e5-01972934299d', '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5', 'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'added': set(), 'removed': set(), 'updated': {'6e8b23b0-bc61-4571-9a21-75bb81bcfa43'}, 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:29:43.820682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Returning: {'device': '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', 'device_id': '3a57b971-3f52-4835-99a8-124d65408ffd', 'network_id': 'ff8958a9-1d15-4a33-98bb-91961388fca3', 'port_id': '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', 'mac_address': 'fa:16:3e:7e:d3:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'aac67899-dc5a-496e-bf8d-d7385b65acc1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107232) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 27 04:29:43.823172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing port: 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 {{(pid=107232) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 27 04:29:43.823501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 updated. Details: {'device': '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', 'device_id': '3a57b971-3f52-4835-99a8-124d65408ffd', 'network_id': 'ff8958a9-1d15-4a33-98bb-91961388fca3', 'port_id': '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', 'mac_address': 'fa:16:3e:7e:d3:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'aac67899-dc5a-496e-bf8d-d7385b65acc1', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Sep 27 04:29:43.824476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6e8b23b0-bc, col_values=(('tag', 14),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:43.824902 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-6e8b23b0-bc, column=vlan_mode) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:43.825338 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-6e8b23b0-bc, column=trunks) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:43.830011 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6e8b23b0-bc, col_values=(('other_config', {'net_uuid': 'ff8958a9-1d15-4a33-98bb-91961388fca3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '114'}),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:29:43.837124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22ebd,OFPFlowMod(buffer_id=4294967295,command=4,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:43.837473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:530 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.017 Sep 27 04:29:43.837853 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refreshing firewall for 1 devices {{(pid=107232) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 27 04:29:43.838153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Refresh firewall rules Sep 27 04:29:43.839248 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information for ports dict_keys([]) {{(pid=107232) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 27 04:29:43.839536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Update security group information {{(pid=107232) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 27 04:29:43.842798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 2 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:29:43.881335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b1291-5a8f-4dc9-9d0d-7d865ee4733d]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:29:43.881986 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:530 - agent port security group processed in 0.061 Sep 27 04:29:43.882710 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Setting status for 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 to UP {{(pid=107232) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 27 04:29:44.012131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up ['6e8b23b0-bc61-4571-9a21-75bb81bcfa43'] and devices down [] completed. Sep 27 04:29:44.012455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:530 - ports processed. Elapsed:0.201 Sep 27 04:29:44.012795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:530 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.201 Sep 27 04:29:45.813379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:531 started Sep 27 04:29:45.817554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ebf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=641000000,duration_sec=1075,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:45.818215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:45.818573 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:531 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:29:47.813513 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:532 started Sep 27 04:29:47.816175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ec1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=640000000,duration_sec=1077,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:47.816777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:47.817493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:532 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:29:49.814587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:533 started Sep 27 04:29:49.818010 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ec3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=641000000,duration_sec=1079,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:49.818583 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:49.818936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:533 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:29:51.815710 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:534 started Sep 27 04:29:51.818329 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ec5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=642000000,duration_sec=1081,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:51.819036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:51.819378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:534 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:29:53.816463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:535 started Sep 27 04:29:53.818894 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ec7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=643000000,duration_sec=1083,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:53.819467 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:53.819818 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:535 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:29:55.817681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:536 started Sep 27 04:29:55.820811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ec9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=645000000,duration_sec=1085,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:55.821383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:55.821761 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:536 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:29:57.494668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-62a2a8bc-908a-4943-9fb0-199de18c1474 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:29:57Z,data_plane_status=None,description='',device_id='298d0196-0c87-4bfd-a862-be6cbe3a28f5',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1712560b-01e8-4b96-8c66-8877d22eba22,mac_address=fa:16:3e:5f:06:56,name='',network_id=df4f6840-004b-4387-a687-683e2895186f,numa_affinity_policy=,project_id='53d86b6e8a8343fca03ca6d38200f23f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1712560b-01e8-4b96-8c66-8877d22eba22),security_group_ids=set([dc8aeeb6-4f41-4b60-b98c-998d780399e1]),status='DOWN',updated_at=2022-09-27T04:29:57Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:29:57.495787 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-62a2a8bc-908a-4943-9fb0-199de18c1474 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (1712560b-01e8-4b96-8c66-8877d22eba22), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:57.496428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-62a2a8bc-908a-4943-9fb0-199de18c1474 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group member updated {'dc8aeeb6-4f41-4b60-b98c-998d780399e1'} Sep 27 04:29:57.819815 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:537 started Sep 27 04:29:57.821403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ecb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=645000000,duration_sec=1087,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:57.822027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:57.822369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:537 - starting polling. Elapsed:0.004 Sep 27 04:29:57.824389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:57.826998 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:537 - port information retrieved. Elapsed:0.008 Sep 27 04:29:57.827331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:537 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:29:57.957160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-652016bf-0169-4d6f-870d-5c982258e75b service neutron] Resource Port 1712560b-01e8-4b96-8c66-8877d22eba22 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=1712560b-01e8-4b96-8c66-8877d22eba22,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=1712560b-01e8-4b96-8c66-8877d22eba22,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:57.957547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-652016bf-0169-4d6f-870d-5c982258e75b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (1712560b-01e8-4b96-8c66-8877d22eba22), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:58.583769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-652016bf-0169-4d6f-870d-5c982258e75b service neutron] Resource Port 1712560b-01e8-4b96-8c66-8877d22eba22 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=1712560b-01e8-4b96-8c66-8877d22eba22,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=1712560b-01e8-4b96-8c66-8877d22eba22,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=1712560b-01e8-4b96-8c66-8877d22eba22,segment=NetworkSegment(3855b0db-49a1-4957-864c-539480ffde2c),segment_id=3855b0db-49a1-4957-864c-539480ffde2c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:29:58.584394 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-652016bf-0169-4d6f-870d-5c982258e75b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (1712560b-01e8-4b96-8c66-8877d22eba22), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:59.819324 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:538 started Sep 27 04:29:59.821702 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ecd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=646000000,duration_sec=1089,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:29:59.822300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:29:59.822638 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:538 - starting polling. Elapsed:0.003 Sep 27 04:29:59.824627 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:29:59.827196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:538 - port information retrieved. Elapsed:0.008 Sep 27 04:29:59.827528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:538 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:30:01.820188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:539 started Sep 27 04:30:01.823530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ecf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=647000000,duration_sec=1091,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:01.824110 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:01.824471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:539 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:03.821247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:540 started Sep 27 04:30:03.830430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ed1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=648000000,duration_sec=1093,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:03.831190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:03.831790 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:540 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:30:05.822567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:541 started Sep 27 04:30:05.824953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ed3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=649000000,duration_sec=1095,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:05.825526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:05.825908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:541 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:30:06.722717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 1712560b-01e8-4b96-8c66-8877d22eba22 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:30:06.723095 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (1712560b-01e8-4b96-8c66-8877d22eba22), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:07.823124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:542 started Sep 27 04:30:07.825577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ed5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=650000000,duration_sec=1097,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:07.826212 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:07.826553 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:542 - starting polling. Elapsed:0.004 Sep 27 04:30:07.828656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:07.831279 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:542 - port information retrieved. Elapsed:0.008 Sep 27 04:30:07.831619 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:542 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:30:08.836050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 1712560b-01e8-4b96-8c66-8877d22eba22 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:30:08.837188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (1712560b-01e8-4b96-8c66-8877d22eba22), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:09.824373 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:543 started Sep 27 04:30:09.826876 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ed7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=651000000,duration_sec=1099,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:09.827470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:09.827813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:543 - starting polling. Elapsed:0.004 Sep 27 04:30:09.829867 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:09.832505 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:543 - port information retrieved. Elapsed:0.008 Sep 27 04:30:09.833330 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:543 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:30:11.826270 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:544 started Sep 27 04:30:11.829223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ed9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=653000000,duration_sec=1101,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:11.829883 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:11.830244 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:544 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:12.040612 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-59d18fe0-b1c4-41cb-920a-8b703d1c30aa tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:30:11Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=82514c3e-b0d5-48a2-aba5-a1b91df98ce5,mac_address=fa:16:3e:91:45:05,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(82514c3e-b0d5-48a2-aba5-a1b91df98ce5),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:30:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:30:12.041103 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-59d18fe0-b1c4-41cb-920a-8b703d1c30aa tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (82514c3e-b0d5-48a2-aba5-a1b91df98ce5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:12.655866 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-59d18fe0-b1c4-41cb-920a-8b703d1c30aa tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource Port 82514c3e-b0d5-48a2-aba5-a1b91df98ce5 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'ff5bcf45-de80-4643-af08-993d124d7f8e'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:30:12.656266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-59d18fe0-b1c4-41cb-920a-8b703d1c30aa tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (82514c3e-b0d5-48a2-aba5-a1b91df98ce5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:13.827151 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:545 started Sep 27 04:30:13.831982 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22edb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=655000000,duration_sec=1103,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:13.832554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:13.832918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:545 - starting polling. Elapsed:0.006 Sep 27 04:30:13.835028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:13.837632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:545 - port information retrieved. Elapsed:0.011 Sep 27 04:30:13.838005 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:545 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:30:15.828188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:546 started Sep 27 04:30:15.830588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22edd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=655000000,duration_sec=1105,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:15.831182 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:15.831535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:546 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:17.829418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:547 started Sep 27 04:30:17.831868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22edf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=656000000,duration_sec=1107,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:17.833004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:17.833405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:547 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:19.830280 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:548 started Sep 27 04:30:19.832701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ee1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=657000000,duration_sec=1109,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:19.833229 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:19.833591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:548 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:30:21.830774 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:549 started Sep 27 04:30:21.833192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ee3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=657000000,duration_sec=1111,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:21.833765 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:21.834131 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:549 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:23.831908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:550 started Sep 27 04:30:23.834861 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ee5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=658000000,duration_sec=1113,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:23.835439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:23.835822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:550 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:25.833152 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:551 started Sep 27 04:30:25.835580 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ee7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=660000000,duration_sec=1115,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:25.836147 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:25.836563 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:551 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:27.833974 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:552 started Sep 27 04:30:27.837059 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ee9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=661000000,duration_sec=1117,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:27.837768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:27.838143 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:552 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:28.374759 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-15567c0b-e427-457f-82eb-02e59e2a612a tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port deleted: 9cf35c89-da17-4b43-a211-771d19ddbbf2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:30:28.375235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-15567c0b-e427-457f-82eb-02e59e2a612a tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (9cf35c89-da17-4b43-a211-771d19ddbbf2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:28.375722 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-15567c0b-e427-457f-82eb-02e59e2a612a tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group member updated {'4a95c94b-f7bf-4515-9419-e7b1d0b5acb8'} Sep 27 04:30:29.795009 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroup deleted: 4a95c94b-f7bf-4515-9419-e7b1d0b5acb8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:30:29.795622 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (4a95c94b-f7bf-4515-9419-e7b1d0b5acb8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:29.796038 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4a95c94b-f7bf-4515-9419-e7b1d0b5acb8',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:30:29.810789 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4a95c94b-f7bf-4515-9419-e7b1d0b5acb8',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:30:29.811241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: 84c0a003-0315-4c00-a00e-7b9bfc0ec35b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:30:29.811618 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (84c0a003-0315-4c00-a00e-7b9bfc0ec35b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:29.811957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['4a95c94b-f7bf-4515-9419-e7b1d0b5acb8'] Sep 27 04:30:29.812355 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: dbd70611-fd20-47b8-a127-2af2082e2f82 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:30:29.812700 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (dbd70611-fd20-47b8-a127-2af2082e2f82), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:29.813021 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['4a95c94b-f7bf-4515-9419-e7b1d0b5acb8'] Sep 27 04:30:29.813455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: 6bfb1e27-5b51-4675-a93d-c34f83a4b30a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:30:29.813847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6bfb1e27-5b51-4675-a93d-c34f83a4b30a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:29.814171 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['4a95c94b-f7bf-4515-9419-e7b1d0b5acb8'] Sep 27 04:30:29.814541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: 393cae3a-ff7e-4362-ae6f-80b37919c8ac {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:30:29.814881 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (393cae3a-ff7e-4362-ae6f-80b37919c8ac), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:29.815197 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5f1b7493-3081-4ea5-8138-979136cf1222 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['4a95c94b-f7bf-4515-9419-e7b1d0b5acb8'] Sep 27 04:30:29.834565 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:553 started Sep 27 04:30:29.837881 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22eeb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=661000000,duration_sec=1119,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:29.838812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:29.839276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:553 - starting polling. Elapsed:0.005 Sep 27 04:30:29.841396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:29.842934 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 9cf35c89-da17-4b43-a211-771d19ddbbf2 not present in bridge br-int Sep 27 04:30:29.843393 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:30:29.843790 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['9cf35c89-da17-4b43-a211-771d19ddbbf2'] Sep 27 04:30:29.844211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 9cf35c89-da17-4b43-a211-771d19ddbbf2 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:30:29.847538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:553 - port information retrieved. Elapsed:0.013 Sep 27 04:30:29.847992 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:553 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 27 04:30:30.189154 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-91986783-ee15-4689-8861-8be0f98386d1 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port deleted: bc88f6f6-e6a2-488d-aaab-c4dd91f3b3e3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:30:30.189611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-91986783-ee15-4689-8861-8be0f98386d1 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (bc88f6f6-e6a2-488d-aaab-c4dd91f3b3e3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:30.456582 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30354c4a-eb60-42df-a154-067b3668769b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:30:30Z,description='tempest-description--268731395',id=e2591773-3de6-4b20-b7cf-0430fcece043,is_default=False,name='tempest-securitygroup--1007767043',project_id='d7c74ffec54740eca3cd6b707f1cb732',revision_number=1,rules=[SecurityGroupRule(2bc0cf4a-d701-46fa-90e2-ae58b24f226f),SecurityGroupRule(e501b03c-0892-48f9-a685-6a6d49435cd5)],shared=False,stateful=True,updated_at=2022-09-27T04:30:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:30:30.456839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30354c4a-eb60-42df-a154-067b3668769b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (e2591773-3de6-4b20-b7cf-0430fcece043), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:30.457473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30354c4a-eb60-42df-a154-067b3668769b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:30:30Z,description=,direction='egress',ethertype='IPv4',id=2bc0cf4a-d701-46fa-90e2-ae58b24f226f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e2591773-3de6-4b20-b7cf-0430fcece043,updated_at=2022-09-27T04:30:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:30:30.457895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30354c4a-eb60-42df-a154-067b3668769b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2bc0cf4a-d701-46fa-90e2-ae58b24f226f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:30.458242 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-30354c4a-eb60-42df-a154-067b3668769b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['e2591773-3de6-4b20-b7cf-0430fcece043'] Sep 27 04:30:30.458922 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-30354c4a-eb60-42df-a154-067b3668769b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:30:30Z,description=,direction='egress',ethertype='IPv6',id=e501b03c-0892-48f9-a685-6a6d49435cd5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e2591773-3de6-4b20-b7cf-0430fcece043,updated_at=2022-09-27T04:30:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:30:30.459281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-30354c4a-eb60-42df-a154-067b3668769b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e501b03c-0892-48f9-a685-6a6d49435cd5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:30.459616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-30354c4a-eb60-42df-a154-067b3668769b tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['e2591773-3de6-4b20-b7cf-0430fcece043'] Sep 27 04:30:30.561009 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ad884dc5-90ea-408c-b062-7afc56a4683c tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:30:30Z,description='',direction='ingress',ethertype='IPv4',id=c43704dd-47ee-45aa-8374-6c107e225508,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e2591773-3de6-4b20-b7cf-0430fcece043,updated_at=2022-09-27T04:30:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:30:30.561392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ad884dc5-90ea-408c-b062-7afc56a4683c tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c43704dd-47ee-45aa-8374-6c107e225508), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:30.561952 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ad884dc5-90ea-408c-b062-7afc56a4683c tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['e2591773-3de6-4b20-b7cf-0430fcece043'] Sep 27 04:30:30.682860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-154c99e6-c384-4c07-8ed0-b9ec1a926984 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:30:30Z,description='',direction='ingress',ethertype='IPv4',id=baaad5fd-a548-4567-9d1c-4dfa9803144b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d7c74ffec54740eca3cd6b707f1cb732',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e2591773-3de6-4b20-b7cf-0430fcece043,updated_at=2022-09-27T04:30:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:30:30.683509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-154c99e6-c384-4c07-8ed0-b9ec1a926984 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (baaad5fd-a548-4567-9d1c-4dfa9803144b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:30.683859 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-154c99e6-c384-4c07-8ed0-b9ec1a926984 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['e2591773-3de6-4b20-b7cf-0430fcece043'] Sep 27 04:30:31.124513 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e030ce7f-4ef5-4758-a804-201eac2c5b7c tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:30:30Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=aec4400e-bc97-4031-8a96-63205a408bdb,mac_address=fa:16:3e:e2:a9:30,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(aec4400e-bc97-4031-8a96-63205a408bdb),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:30:30Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:30:31.125144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e030ce7f-4ef5-4758-a804-201eac2c5b7c tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (aec4400e-bc97-4031-8a96-63205a408bdb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:31.442054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e030ce7f-4ef5-4758-a804-201eac2c5b7c tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port aec4400e-bc97-4031-8a96-63205a408bdb updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'ce08fc7c-e612-4460-a0fa-1f57571dd8c9'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:30:31.442454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e030ce7f-4ef5-4758-a804-201eac2c5b7c tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (aec4400e-bc97-4031-8a96-63205a408bdb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:31.835694 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:554 started Sep 27 04:30:31.838535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22eed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=663000000,duration_sec=1121,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:31.839163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:31.839545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:554 - starting polling. Elapsed:0.004 Sep 27 04:30:31.841699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:31.843119 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port bc88f6f6-e6a2-488d-aaab-c4dd91f3b3e3 not present in bridge br-int Sep 27 04:30:31.843459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:30:31.843746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['bc88f6f6-e6a2-488d-aaab-c4dd91f3b3e3'] Sep 27 04:30:31.844076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port bc88f6f6-e6a2-488d-aaab-c4dd91f3b3e3 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:30:31.846583 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:554 - port information retrieved. Elapsed:0.011 Sep 27 04:30:31.847166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:554 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:30:33.837190 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:555 started Sep 27 04:30:33.840067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22eef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=664000000,duration_sec=1123,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:33.840766 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:33.841193 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:555 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:33.870358 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1d901d41-dcaa-423e-b9d4-93715d8f385c tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:30:33Z,data_plane_status=None,description='',device_id='e293adc2-d0ac-46d7-92a9-a61e55ca2f5e',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ba58590d-7cc5-40df-a30e-19ed0c34f9b2,mac_address=fa:16:3e:e3:9c:67,name='',network_id=cba0fe06-d029-4450-9dfd-fb0123caa50b,numa_affinity_policy=,project_id='d7c74ffec54740eca3cd6b707f1cb732',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ba58590d-7cc5-40df-a30e-19ed0c34f9b2),security_group_ids=set([e2591773-3de6-4b20-b7cf-0430fcece043]),status='DOWN',updated_at=2022-09-27T04:30:33Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:30:33.870746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1d901d41-dcaa-423e-b9d4-93715d8f385c tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ba58590d-7cc5-40df-a30e-19ed0c34f9b2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:33.871207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-1d901d41-dcaa-423e-b9d4-93715d8f385c tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group member updated {'e2591773-3de6-4b20-b7cf-0430fcece043'} Sep 27 04:30:34.382966 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-97e6e127-998a-4939-a9d8-42451cd4972f service neutron] Resource Port ba58590d-7cc5-40df-a30e-19ed0c34f9b2 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=ba58590d-7cc5-40df-a30e-19ed0c34f9b2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=ba58590d-7cc5-40df-a30e-19ed0c34f9b2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:30:34.383354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-97e6e127-998a-4939-a9d8-42451cd4972f service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ba58590d-7cc5-40df-a30e-19ed0c34f9b2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:34.694090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-97e6e127-998a-4939-a9d8-42451cd4972f service neutron] Resource Port ba58590d-7cc5-40df-a30e-19ed0c34f9b2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=ba58590d-7cc5-40df-a30e-19ed0c34f9b2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=ba58590d-7cc5-40df-a30e-19ed0c34f9b2,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=ba58590d-7cc5-40df-a30e-19ed0c34f9b2,segment=NetworkSegment(c5746d98-25dd-46c1-b1b6-0887fcb5090c),segment_id=c5746d98-25dd-46c1-b1b6-0887fcb5090c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:30:34.694458 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-97e6e127-998a-4939-a9d8-42451cd4972f service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ba58590d-7cc5-40df-a30e-19ed0c34f9b2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:35.838089 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:556 started Sep 27 04:30:35.840507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ef1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=665000000,duration_sec=1125,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:35.841082 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:35.841419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:556 - starting polling. Elapsed:0.004 Sep 27 04:30:35.843457 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:35.846035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:556 - port information retrieved. Elapsed:0.008 Sep 27 04:30:35.846371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:556 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:30:36.852264 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port ba58590d-7cc5-40df-a30e-19ed0c34f9b2 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:30:36.852911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ba58590d-7cc5-40df-a30e-19ed0c34f9b2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:37.838601 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:557 started Sep 27 04:30:37.841300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ef3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=666000000,duration_sec=1127,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:37.841907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:37.842248 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:557 - starting polling. Elapsed:0.004 Sep 27 04:30:37.844255 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:37.846847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:557 - port information retrieved. Elapsed:0.008 Sep 27 04:30:37.847179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:557 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:30:38.809436 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port ba58590d-7cc5-40df-a30e-19ed0c34f9b2 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:30:38.810120 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (ba58590d-7cc5-40df-a30e-19ed0c34f9b2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:39.839187 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:558 started Sep 27 04:30:39.842564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ef5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=666000000,duration_sec=1129,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:39.843152 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:39.843497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:558 - starting polling. Elapsed:0.005 Sep 27 04:30:39.845503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:30:39.848587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:558 - port information retrieved. Elapsed:0.010 Sep 27 04:30:39.848926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:558 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:30:41.839749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:559 started Sep 27 04:30:41.844347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ef7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=666000000,duration_sec=1131,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:41.844942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:41.845314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:559 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:30:43.841604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:560 started Sep 27 04:30:43.844553 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ef9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=668000000,duration_sec=1133,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:43.845372 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:43.845731 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:560 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:30:45.842626 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:561 started Sep 27 04:30:45.845291 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22efb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=669000000,duration_sec=1135,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:45.845975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:45.846325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:561 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:47.843575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:562 started Sep 27 04:30:47.845821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22efd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=670000000,duration_sec=1137,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:47.846388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:47.846762 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:562 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:30:49.844547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:563 started Sep 27 04:30:49.847159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22eff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=671000000,duration_sec=1139,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:49.847744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:49.848101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:563 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:51.845928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:564 started Sep 27 04:30:51.848670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f01,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=673000000,duration_sec=1141,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:51.849336 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:51.849698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:564 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:53.847078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:565 started Sep 27 04:30:53.849425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f03,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=674000000,duration_sec=1143,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:53.850048 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:53.850397 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:565 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:30:55.848227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:566 started Sep 27 04:30:55.850639 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f05,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=675000000,duration_sec=1145,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:55.851210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:55.851557 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:566 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:57.848895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:567 started Sep 27 04:30:57.851398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f07,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=675000000,duration_sec=1147,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:57.851973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:57.852323 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:567 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:30:59.850386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:568 started Sep 27 04:30:59.852734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f09,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=677000000,duration_sec=1149,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:30:59.853875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:30:59.854321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:568 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:01.851234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:569 started Sep 27 04:31:01.854307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f0b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=678000000,duration_sec=1151,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:01.854931 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:01.855309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:569 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:03.852712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:570 started Sep 27 04:31:03.855627 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f0d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=680000000,duration_sec=1153,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:03.856217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:03.856567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:570 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:05.853904 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:571 started Sep 27 04:31:05.856326 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f0f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=680000000,duration_sec=1155,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:05.856930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:05.857311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:571 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:07.855247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:572 started Sep 27 04:31:07.861390 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f11,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=682000000,duration_sec=1157,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:07.862000 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:07.862357 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:572 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 27 04:31:09.856719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:573 started Sep 27 04:31:09.859109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f13,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=683000000,duration_sec=1159,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:09.859669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:09.860017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:573 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:31:11.857346 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:574 started Sep 27 04:31:11.860303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f15,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=684000000,duration_sec=1161,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:11.860935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:11.861323 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:574 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:13.857915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:575 started Sep 27 04:31:13.860248 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f17,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=684000000,duration_sec=1163,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:13.860812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:13.861160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:575 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:31:15.859236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:576 started Sep 27 04:31:15.861616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f19,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=686000000,duration_sec=1165,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:15.862217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:15.862574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:576 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:31:17.860049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:577 started Sep 27 04:31:17.862340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f1b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=687000000,duration_sec=1167,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:17.862915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:17.863276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:577 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:31:19.861446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:578 started Sep 27 04:31:19.864031 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f1d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=688000000,duration_sec=1169,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:19.864607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:19.864965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:578 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:21.862509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:579 started Sep 27 04:31:21.865110 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f1f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=689000000,duration_sec=1171,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:21.865684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:21.866069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:579 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:23.863620 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:580 started Sep 27 04:31:23.866749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f21,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=690000000,duration_sec=1173,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:23.867313 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:23.867666 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:580 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:25.865141 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:581 started Sep 27 04:31:25.867541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f23,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=692000000,duration_sec=1175,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:25.868111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:25.868464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:581 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:27.866090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:582 started Sep 27 04:31:27.868415 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f25,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=693000000,duration_sec=1177,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:27.868983 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:27.869331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:582 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:31:29.866686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:583 started Sep 27 04:31:29.869479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f27,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=693000000,duration_sec=1179,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:29.870086 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:29.870444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:583 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:31.867899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:584 started Sep 27 04:31:31.871351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f29,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=695000000,duration_sec=1181,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:31.872118 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:31.872465 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:584 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:31:31.987561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d55d9035-2d23-40b4-a2dd-e83d3ef1f225 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port deleted: ba58590d-7cc5-40df-a30e-19ed0c34f9b2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:31.988135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d55d9035-2d23-40b4-a2dd-e83d3ef1f225 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (ba58590d-7cc5-40df-a30e-19ed0c34f9b2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:31.988524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d55d9035-2d23-40b4-a2dd-e83d3ef1f225 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group member updated {'e2591773-3de6-4b20-b7cf-0430fcece043'} Sep 27 04:31:33.385997 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroup deleted: e2591773-3de6-4b20-b7cf-0430fcece043 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:33.386588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (e2591773-3de6-4b20-b7cf-0430fcece043), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:33.386851 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e2591773-3de6-4b20-b7cf-0430fcece043',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:31:33.402869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e2591773-3de6-4b20-b7cf-0430fcece043',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:31:33.403329 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: 2bc0cf4a-d701-46fa-90e2-ae58b24f226f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:33.403702 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2bc0cf4a-d701-46fa-90e2-ae58b24f226f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:33.404179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['e2591773-3de6-4b20-b7cf-0430fcece043'] Sep 27 04:31:33.404848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: e501b03c-0892-48f9-a685-6a6d49435cd5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:33.405253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e501b03c-0892-48f9-a685-6a6d49435cd5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:33.405586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['e2591773-3de6-4b20-b7cf-0430fcece043'] Sep 27 04:31:33.405984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: c43704dd-47ee-45aa-8374-6c107e225508 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:33.408083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c43704dd-47ee-45aa-8374-6c107e225508), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:33.408428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['e2591773-3de6-4b20-b7cf-0430fcece043'] Sep 27 04:31:33.408818 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource SecurityGroupRule deleted: baaad5fd-a548-4567-9d1c-4dfa9803144b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:33.409168 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (baaad5fd-a548-4567-9d1c-4dfa9803144b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:33.409713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ef42818a-68b2-4c12-8d1f-331627553710 tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Security group rule updated ['e2591773-3de6-4b20-b7cf-0430fcece043'] Sep 27 04:31:33.772948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-cbe7713c-b0c3-411f-8167-75e7b252641d tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Resource Port deleted: aec4400e-bc97-4031-8a96-63205a408bdb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:33.773333 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-cbe7713c-b0c3-411f-8167-75e7b252641d tempest-AttachVolumeNegativeTest-139081326 tempest-AttachVolumeNegativeTest-139081326-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (aec4400e-bc97-4031-8a96-63205a408bdb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:33.868811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:585 started Sep 27 04:31:33.871238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f2b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=695000000,duration_sec=1183,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:33.871820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:33.872161 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:585 - starting polling. Elapsed:0.004 Sep 27 04:31:33.874210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:33.875570 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ba58590d-7cc5-40df-a30e-19ed0c34f9b2 not present in bridge br-int Sep 27 04:31:33.875898 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:31:33.877197 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port aec4400e-bc97-4031-8a96-63205a408bdb not present in bridge br-int Sep 27 04:31:33.877516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:31:33.877889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['ba58590d-7cc5-40df-a30e-19ed0c34f9b2', 'aec4400e-bc97-4031-8a96-63205a408bdb'] Sep 27 04:31:33.878238 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port ba58590d-7cc5-40df-a30e-19ed0c34f9b2 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:31:33.878596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port aec4400e-bc97-4031-8a96-63205a408bdb is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:31:33.881161 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:585 - port information retrieved. Elapsed:0.012 Sep 27 04:31:33.881496 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:585 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 27 04:31:35.869519 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:586 started Sep 27 04:31:35.871866 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f2d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=696000000,duration_sec=1185,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:35.872430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:35.872779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:586 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:31:37.870062 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:587 started Sep 27 04:31:37.872325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f2f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=697000000,duration_sec=1187,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:37.872890 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:37.873236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:587 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:31:38.347026 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-94b7e118-8960-494b-a09f-069dd407f29a admin admin] Resource Port deleted: a232fa3d-5135-4b2b-beba-1695e497a1d7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:38.347412 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-94b7e118-8960-494b-a09f-069dd407f29a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (a232fa3d-5135-4b2b-beba-1695e497a1d7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:39.713042 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bc8a9830-c683-4988-92e5-34fa841af5c3 admin admin] Resource Port deleted: df24a64e-a855-4c93-9fc9-4c4a85f449c2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:39.713771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bc8a9830-c683-4988-92e5-34fa841af5c3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (df24a64e-a855-4c93-9fc9-4c4a85f449c2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:39.747814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["024e55ab-b6e8-4327-bfb6-f844aec22374","delete","qr-a232fa3d-51",31,["map",[["attached-mac","fa:16:3e:40:05:11"],["iface-id","a232fa3d-5135-4b2b-beba-1695e497a1d7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:31:39.871305 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:588 started Sep 27 04:31:39.873877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f31,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=698000000,duration_sec=1189,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:39.874648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:39.875067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:588 - starting polling. Elapsed:0.004 Sep 27 04:31:39.877225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:39.880122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-df24a64e-a8, col_values=(('tag', 4095),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:31:39.885507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3efe49e5-2581-459d-b9db-2fbcfe7b5402","delete","qg-df24a64e-a8",32,["map",[["attached-mac","fa:16:3e:61:98:65"],["iface-id","df24a64e-a855-4c93-9fc9-4c4a85f449c2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:31:40.200204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22f33,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:40.200929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['df24a64e-a855-4c93-9fc9-4c4a85f449c2'] Sep 27 04:31:40.201480 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:31:40.213846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-980e6568-358b-4e14-816d-956964f426e2 admin admin] Resource Subnet deleted: d4d9fbf8-be25-413e-9d9a-4acede1bc3df {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:40.214940 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-980e6568-358b-4e14-816d-956964f426e2 admin admin] Publish callbacks [] for Subnet (d4d9fbf8-be25-413e-9d9a-4acede1bc3df), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:40.249662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2732caf-230f-43f9-877c-812e2a2e6107]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:31:40.256426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22f35,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:40.258317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22f37,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:40.258639 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:588 - port information retrieved. Elapsed:0.388 Sep 27 04:31:40.259150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'ab3d6ea0-0620-4743-82ab-fc092700f894', '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'df24a64e-a855-4c93-9fc9-4c4a85f449c2', '393bbc50-ff65-4a57-99fb-482a15b5ad7c', '25a54548-54d9-441f-b9e5-01972934299d', '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': {'a232fa3d-5135-4b2b-beba-1695e497a1d7'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:31:40.259661 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:588 - agent port security group processed in 0.000 Sep 27 04:31:40.261292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:31:40.261600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'a232fa3d-5135-4b2b-beba-1695e497a1d7'} Sep 27 04:31:40.266446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:31:40.306076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b084a00-7e19-4080-b6f4-fce5428f44df]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:31:40.306724 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'a232fa3d-5135-4b2b-beba-1695e497a1d7'} removed Sep 27 04:31:40.358307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:31:40.358998 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:588 - treat_devices_removed completed in 0.097 Sep 27 04:31:40.359491 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:588 - ports processed. Elapsed:0.488 Sep 27 04:31:40.360073 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:588 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.489 Sep 27 04:31:40.398963 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["59ed49f2-d5b6-4f21-993a-f1ef7fd19086","delete","tap4fb3a760-0b",30,["map",[["attached-mac","fa:16:3e:32:0d:4e"],["iface-id","4fb3a760-0b2e-4b6c-b229-ad4e9b60031e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:31:40.600957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e4ed1ae-ac89-4cd5-959f-4159e2defbda admin admin] Resource Port deleted: 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:40.601792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e4ed1ae-ac89-4cd5-959f-4159e2defbda admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (4fb3a760-0b2e-4b6c-b229-ad4e9b60031e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:40.700972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ce96af52-d670-4a7d-8df3-587c7a88d8d8 None None] Resource Port deleted: 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:40.701619 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ce96af52-d670-4a7d-8df3-587c7a88d8d8 None None] Skipped duplicate delete event for 4fb3a760-0b2e-4b6c-b229-ad4e9b60031e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 27 04:31:40.829363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1e4ed1ae-ac89-4cd5-959f-4159e2defbda admin admin] Resource Network deleted: cba0fe06-d029-4450-9dfd-fb0123caa50b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:40.830484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1e4ed1ae-ac89-4cd5-959f-4159e2defbda admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (cba0fe06-d029-4450-9dfd-fb0123caa50b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:41.173331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Resource SecurityGroup deleted: c279fa26-f34d-4447-83b5-945b6c520f46 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:41.173788 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (c279fa26-f34d-4447-83b5-945b6c520f46), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:41.174326 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c279fa26-f34d-4447-83b5-945b6c520f46',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:31:41.189094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c279fa26-f34d-4447-83b5-945b6c520f46',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:31:41.189544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Resource SecurityGroupRule deleted: 18f2a32c-72c3-41d4-a336-96f5702dd4e1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:41.190028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (18f2a32c-72c3-41d4-a336-96f5702dd4e1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:41.190364 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Security group rule updated ['c279fa26-f34d-4447-83b5-945b6c520f46'] Sep 27 04:31:41.190767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Resource SecurityGroupRule deleted: 781e6a96-9aea-45dd-a6f9-05c87ae858fd {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:41.191157 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (781e6a96-9aea-45dd-a6f9-05c87ae858fd), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:41.191480 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Security group rule updated ['c279fa26-f34d-4447-83b5-945b6c520f46'] Sep 27 04:31:41.191853 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Resource SecurityGroupRule deleted: 95eed30f-7c03-44f4-8c8c-f03f78e1f11c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:41.192194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (95eed30f-7c03-44f4-8c8c-f03f78e1f11c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:41.192513 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Security group rule updated ['c279fa26-f34d-4447-83b5-945b6c520f46'] Sep 27 04:31:41.192899 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Resource SecurityGroupRule deleted: b9ad98d7-fdb9-4466-99b0-6924858a5dba {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:41.193239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b9ad98d7-fdb9-4466-99b0-6924858a5dba), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:41.193552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b1bd759d-d426-4cf5-b446-8c496c3ea5b3 admin admin] Security group rule updated ['c279fa26-f34d-4447-83b5-945b6c520f46'] Sep 27 04:31:41.871917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:589 started Sep 27 04:31:41.874723 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f39,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=699000000,duration_sec=1191,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:41.875311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:41.876054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:589 - starting polling. Elapsed:0.004 Sep 27 04:31:41.877876 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:41.881806 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc22f3b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:41.881953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:589 - port information retrieved. Elapsed:0.010 Sep 27 04:31:41.882276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'ab3d6ea0-0620-4743-82ab-fc092700f894', '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '393bbc50-ff65-4a57-99fb-482a15b5ad7c', '25a54548-54d9-441f-b9e5-01972934299d', '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': {'df24a64e-a855-4c93-9fc9-4c4a85f449c2', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:31:41.882611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:589 - agent port security group processed in 0.000 Sep 27 04:31:41.884133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:31:41.884445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'df24a64e-a855-4c93-9fc9-4c4a85f449c2', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e'} Sep 27 04:31:41.884808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port df24a64e-a855-4c93-9fc9-4c4a85f449c2 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:31:41.885225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:31:41.932767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[109e8f46-3136-4ebe-aaad-b41450dc6682]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:31:41.933287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'df24a64e-a855-4c93-9fc9-4c4a85f449c2', '4fb3a760-0b2e-4b6c-b229-ad4e9b60031e'} removed Sep 27 04:31:41.978320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:31:41.978696 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:31:41.979081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 12 from net-id = cba0fe06-d029-4450-9dfd-fb0123caa50b, seg-id = 112 Sep 27 04:31:41.981721 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32ec7,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:41.984335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc22f3d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4208}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:41.984662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:589 - treat_devices_removed completed in 0.100 Sep 27 04:31:41.984962 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:589 - ports processed. Elapsed:0.113 Sep 27 04:31:41.985325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:589 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.114 Sep 27 04:31:43.872618 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:590 started Sep 27 04:31:43.875077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f3f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=699000000,duration_sec=1193,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:43.875646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:43.876015 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:590 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:45.140824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:31:45Z,description='Default security group',id=1b476d26-85b3-4b23-9d83-7649a69fd88e,is_default=True,name='default',project_id='b86c8a654e564d8fbe35c070363144f1',revision_number=1,rules=[SecurityGroupRule(1905695c-9668-4a97-b1e4-85a35df56677),SecurityGroupRule(5f21c4c2-614a-49b3-8cff-0687ed4e741f),SecurityGroupRule(6334e646-470e-4b0f-9f0f-1e8fd4ff0d48),SecurityGroupRule(983c33bd-0e5e-4a00-868e-056d19b94b6a)],shared=False,stateful=True,updated_at=2022-09-27T04:31:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:45.141404 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (1b476d26-85b3-4b23-9d83-7649a69fd88e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:45.141950 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:45Z,description=,direction='ingress',ethertype='IPv6',id=1905695c-9668-4a97-b1e4-85a35df56677,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b86c8a654e564d8fbe35c070363144f1',protocol=,remote_address_group_id=,remote_group_id=1b476d26-85b3-4b23-9d83-7649a69fd88e,remote_ip_prefix=,revision_number=0,security_group_id=1b476d26-85b3-4b23-9d83-7649a69fd88e,updated_at=2022-09-27T04:31:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:45.142312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1905695c-9668-4a97-b1e4-85a35df56677), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:45.142646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Security group rule updated ['1b476d26-85b3-4b23-9d83-7649a69fd88e'] Sep 27 04:31:45.143317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:45Z,description=,direction='ingress',ethertype='IPv4',id=5f21c4c2-614a-49b3-8cff-0687ed4e741f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b86c8a654e564d8fbe35c070363144f1',protocol=,remote_address_group_id=,remote_group_id=1b476d26-85b3-4b23-9d83-7649a69fd88e,remote_ip_prefix=,revision_number=0,security_group_id=1b476d26-85b3-4b23-9d83-7649a69fd88e,updated_at=2022-09-27T04:31:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:45.143669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (5f21c4c2-614a-49b3-8cff-0687ed4e741f), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:45.143993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Security group rule updated ['1b476d26-85b3-4b23-9d83-7649a69fd88e'] Sep 27 04:31:45.144637 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:45Z,description=,direction='egress',ethertype='IPv6',id=6334e646-470e-4b0f-9f0f-1e8fd4ff0d48,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b86c8a654e564d8fbe35c070363144f1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1b476d26-85b3-4b23-9d83-7649a69fd88e,updated_at=2022-09-27T04:31:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:45.145006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6334e646-470e-4b0f-9f0f-1e8fd4ff0d48), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:45.145328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Security group rule updated ['1b476d26-85b3-4b23-9d83-7649a69fd88e'] Sep 27 04:31:45.145994 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:45Z,description=,direction='egress',ethertype='IPv4',id=983c33bd-0e5e-4a00-868e-056d19b94b6a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b86c8a654e564d8fbe35c070363144f1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1b476d26-85b3-4b23-9d83-7649a69fd88e,updated_at=2022-09-27T04:31:45Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:45.146341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (983c33bd-0e5e-4a00-868e-056d19b94b6a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:45.146662 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9ae42e63-553b-4542-b741-fe16186851a2 admin admin] Security group rule updated ['1b476d26-85b3-4b23-9d83-7649a69fd88e'] Sep 27 04:31:45.266322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Resource SecurityGroup deleted: 1b476d26-85b3-4b23-9d83-7649a69fd88e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:45.266803 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (1b476d26-85b3-4b23-9d83-7649a69fd88e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:45.267333 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1b476d26-85b3-4b23-9d83-7649a69fd88e',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:31:45.280684 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1b476d26-85b3-4b23-9d83-7649a69fd88e',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:31:45.281180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Resource SecurityGroupRule deleted: 1905695c-9668-4a97-b1e4-85a35df56677 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:45.281692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1905695c-9668-4a97-b1e4-85a35df56677), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:45.282080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Security group rule updated ['1b476d26-85b3-4b23-9d83-7649a69fd88e'] Sep 27 04:31:45.282567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Resource SecurityGroupRule deleted: 5f21c4c2-614a-49b3-8cff-0687ed4e741f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:45.283022 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (5f21c4c2-614a-49b3-8cff-0687ed4e741f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:45.283408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Security group rule updated ['1b476d26-85b3-4b23-9d83-7649a69fd88e'] Sep 27 04:31:45.283835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Resource SecurityGroupRule deleted: 6334e646-470e-4b0f-9f0f-1e8fd4ff0d48 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:45.284972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6334e646-470e-4b0f-9f0f-1e8fd4ff0d48), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:45.285356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Security group rule updated ['1b476d26-85b3-4b23-9d83-7649a69fd88e'] Sep 27 04:31:45.285884 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Resource SecurityGroupRule deleted: 983c33bd-0e5e-4a00-868e-056d19b94b6a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:45.286306 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (983c33bd-0e5e-4a00-868e-056d19b94b6a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:45.286673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-855dcfea-26c0-45de-b524-163de92fc18f admin admin] Security group rule updated ['1b476d26-85b3-4b23-9d83-7649a69fd88e'] Sep 27 04:31:45.873706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:591 started Sep 27 04:31:45.876120 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f41,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=700000000,duration_sec=1195,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:45.876698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:45.877051 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:591 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:47.874903 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:592 started Sep 27 04:31:47.877184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f43,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=701000000,duration_sec=1197,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:47.877804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:47.878157 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:592 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:31:49.875989 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:593 started Sep 27 04:31:49.882909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f45,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=703000000,duration_sec=1199,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:49.883512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:49.883882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:593 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:31:50.374331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:31:50Z,description='Default security group',id=199c85b4-63f7-4bed-b738-ba2d0e60ed71,is_default=True,name='default',project_id='d64dbf9717824ea0b2299081aa8cb230',revision_number=1,rules=[SecurityGroupRule(11f94d53-a4d4-4032-a01b-53dbeccb7892),SecurityGroupRule(70db61d3-e976-446e-84a8-9ed5181e72ce),SecurityGroupRule(cfc308cc-1f8b-436f-a02e-35a8f8a6407c),SecurityGroupRule(e6677a01-71c9-4180-b07e-213169a1aebf)],shared=False,stateful=True,updated_at=2022-09-27T04:31:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:50.374712 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (199c85b4-63f7-4bed-b738-ba2d0e60ed71), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.375339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:50Z,description=,direction='ingress',ethertype='IPv4',id=11f94d53-a4d4-4032-a01b-53dbeccb7892,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d64dbf9717824ea0b2299081aa8cb230',protocol=,remote_address_group_id=,remote_group_id=199c85b4-63f7-4bed-b738-ba2d0e60ed71,remote_ip_prefix=,revision_number=0,security_group_id=199c85b4-63f7-4bed-b738-ba2d0e60ed71,updated_at=2022-09-27T04:31:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:50.375703 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (11f94d53-a4d4-4032-a01b-53dbeccb7892), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.376039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Security group rule updated ['199c85b4-63f7-4bed-b738-ba2d0e60ed71'] Sep 27 04:31:50.376710 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:50Z,description=,direction='egress',ethertype='IPv6',id=70db61d3-e976-446e-84a8-9ed5181e72ce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d64dbf9717824ea0b2299081aa8cb230',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=199c85b4-63f7-4bed-b738-ba2d0e60ed71,updated_at=2022-09-27T04:31:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:50.377064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (70db61d3-e976-446e-84a8-9ed5181e72ce), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.377398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Security group rule updated ['199c85b4-63f7-4bed-b738-ba2d0e60ed71'] Sep 27 04:31:50.378078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:50Z,description=,direction='egress',ethertype='IPv4',id=cfc308cc-1f8b-436f-a02e-35a8f8a6407c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d64dbf9717824ea0b2299081aa8cb230',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=199c85b4-63f7-4bed-b738-ba2d0e60ed71,updated_at=2022-09-27T04:31:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:50.378442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cfc308cc-1f8b-436f-a02e-35a8f8a6407c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.378767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Security group rule updated ['199c85b4-63f7-4bed-b738-ba2d0e60ed71'] Sep 27 04:31:50.379428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:50Z,description=,direction='ingress',ethertype='IPv6',id=e6677a01-71c9-4180-b07e-213169a1aebf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d64dbf9717824ea0b2299081aa8cb230',protocol=,remote_address_group_id=,remote_group_id=199c85b4-63f7-4bed-b738-ba2d0e60ed71,remote_ip_prefix=,revision_number=0,security_group_id=199c85b4-63f7-4bed-b738-ba2d0e60ed71,updated_at=2022-09-27T04:31:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:50.379781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e6677a01-71c9-4180-b07e-213169a1aebf), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.380109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9a35afbe-1bbe-402d-88e2-9f879d9fb405 admin admin] Security group rule updated ['199c85b4-63f7-4bed-b738-ba2d0e60ed71'] Sep 27 04:31:50.501052 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Resource SecurityGroup deleted: 199c85b4-63f7-4bed-b738-ba2d0e60ed71 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:50.501463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (199c85b4-63f7-4bed-b738-ba2d0e60ed71), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.502069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('199c85b4-63f7-4bed-b738-ba2d0e60ed71',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:31:50.518079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('199c85b4-63f7-4bed-b738-ba2d0e60ed71',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:31:50.518752 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Resource SecurityGroupRule deleted: 11f94d53-a4d4-4032-a01b-53dbeccb7892 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:50.519309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (11f94d53-a4d4-4032-a01b-53dbeccb7892), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.519746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Security group rule updated ['199c85b4-63f7-4bed-b738-ba2d0e60ed71'] Sep 27 04:31:50.520159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Resource SecurityGroupRule deleted: 70db61d3-e976-446e-84a8-9ed5181e72ce {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:50.520516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (70db61d3-e976-446e-84a8-9ed5181e72ce), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.520842 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Security group rule updated ['199c85b4-63f7-4bed-b738-ba2d0e60ed71'] Sep 27 04:31:50.521218 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Resource SecurityGroupRule deleted: cfc308cc-1f8b-436f-a02e-35a8f8a6407c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:50.521565 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cfc308cc-1f8b-436f-a02e-35a8f8a6407c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.521911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Security group rule updated ['199c85b4-63f7-4bed-b738-ba2d0e60ed71'] Sep 27 04:31:50.522287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Resource SecurityGroupRule deleted: e6677a01-71c9-4180-b07e-213169a1aebf {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:50.522629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e6677a01-71c9-4180-b07e-213169a1aebf), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.522948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-47493d2f-29d8-40d4-920d-0efbe70ec966 admin admin] Security group rule updated ['199c85b4-63f7-4bed-b738-ba2d0e60ed71'] Sep 27 04:31:50.892232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:31:50Z,description='Default security group',id=03a53e56-fb48-404b-a012-f4cddbcb1da6,is_default=True,name='default',project_id='49c68419968342f5aba58695e36ba599',revision_number=1,rules=[SecurityGroupRule(15017d44-11da-49e7-808d-b77194b9f5e8),SecurityGroupRule(574a2654-2836-4716-a9bb-8aaaadaa7521),SecurityGroupRule(a78e2bda-3b57-460b-99da-263005f641a7),SecurityGroupRule(f9efe31d-d268-441d-aa4e-4250d0926f1a)],shared=False,stateful=True,updated_at=2022-09-27T04:31:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:50.893969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (03a53e56-fb48-404b-a012-f4cddbcb1da6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.894607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:50Z,description=,direction='egress',ethertype='IPv4',id=15017d44-11da-49e7-808d-b77194b9f5e8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='49c68419968342f5aba58695e36ba599',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=03a53e56-fb48-404b-a012-f4cddbcb1da6,updated_at=2022-09-27T04:31:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:50.894978 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (15017d44-11da-49e7-808d-b77194b9f5e8), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.895319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Security group rule updated ['03a53e56-fb48-404b-a012-f4cddbcb1da6'] Sep 27 04:31:50.895999 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:50Z,description=,direction='ingress',ethertype='IPv4',id=574a2654-2836-4716-a9bb-8aaaadaa7521,normalized_cidr=None,port_range_max=,port_range_min=,project_id='49c68419968342f5aba58695e36ba599',protocol=,remote_address_group_id=,remote_group_id=03a53e56-fb48-404b-a012-f4cddbcb1da6,remote_ip_prefix=,revision_number=0,security_group_id=03a53e56-fb48-404b-a012-f4cddbcb1da6,updated_at=2022-09-27T04:31:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:50.896378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (574a2654-2836-4716-a9bb-8aaaadaa7521), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.896945 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Security group rule updated ['03a53e56-fb48-404b-a012-f4cddbcb1da6'] Sep 27 04:31:50.897641 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:50Z,description=,direction='egress',ethertype='IPv6',id=a78e2bda-3b57-460b-99da-263005f641a7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='49c68419968342f5aba58695e36ba599',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=03a53e56-fb48-404b-a012-f4cddbcb1da6,updated_at=2022-09-27T04:31:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:50.898030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a78e2bda-3b57-460b-99da-263005f641a7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.898360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Security group rule updated ['03a53e56-fb48-404b-a012-f4cddbcb1da6'] Sep 27 04:31:50.899021 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:50Z,description=,direction='ingress',ethertype='IPv6',id=f9efe31d-d268-441d-aa4e-4250d0926f1a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='49c68419968342f5aba58695e36ba599',protocol=,remote_address_group_id=,remote_group_id=03a53e56-fb48-404b-a012-f4cddbcb1da6,remote_ip_prefix=,revision_number=0,security_group_id=03a53e56-fb48-404b-a012-f4cddbcb1da6,updated_at=2022-09-27T04:31:50Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:50.899376 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f9efe31d-d268-441d-aa4e-4250d0926f1a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:50.899781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-bbc86720-d161-4c9d-950f-f7cce24526d0 admin admin] Security group rule updated ['03a53e56-fb48-404b-a012-f4cddbcb1da6'] Sep 27 04:31:51.025648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Resource SecurityGroup deleted: 03a53e56-fb48-404b-a012-f4cddbcb1da6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:51.026060 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (03a53e56-fb48-404b-a012-f4cddbcb1da6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.026809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('03a53e56-fb48-404b-a012-f4cddbcb1da6',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:31:51.040363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('03a53e56-fb48-404b-a012-f4cddbcb1da6',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:31:51.041526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Resource SecurityGroupRule deleted: 15017d44-11da-49e7-808d-b77194b9f5e8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:51.042153 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (15017d44-11da-49e7-808d-b77194b9f5e8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.042674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Security group rule updated ['03a53e56-fb48-404b-a012-f4cddbcb1da6'] Sep 27 04:31:51.043331 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Resource SecurityGroupRule deleted: 574a2654-2836-4716-a9bb-8aaaadaa7521 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:51.043688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (574a2654-2836-4716-a9bb-8aaaadaa7521), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.044017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Security group rule updated ['03a53e56-fb48-404b-a012-f4cddbcb1da6'] Sep 27 04:31:51.044402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Resource SecurityGroupRule deleted: a78e2bda-3b57-460b-99da-263005f641a7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:51.044752 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a78e2bda-3b57-460b-99da-263005f641a7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.045101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Security group rule updated ['03a53e56-fb48-404b-a012-f4cddbcb1da6'] Sep 27 04:31:51.045476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Resource SecurityGroupRule deleted: f9efe31d-d268-441d-aa4e-4250d0926f1a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:51.045986 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f9efe31d-d268-441d-aa4e-4250d0926f1a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.046311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c479fd19-eaca-482c-b98e-882b3ad044c6 admin admin] Security group rule updated ['03a53e56-fb48-404b-a012-f4cddbcb1da6'] Sep 27 04:31:51.484915 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:31:51Z,description='Default security group',id=9fc8c422-8c07-4d6a-a960-01299e4a0f02,is_default=True,name='default',project_id='9b4b56408d05473c8d33404de411de7b',revision_number=1,rules=[SecurityGroupRule(079427ae-5504-43fd-ae27-87a8e0cd5cf6),SecurityGroupRule(a8a71cbc-1649-4ed0-ba2f-1f02c6443f40),SecurityGroupRule(cee545c6-056f-4289-8e3c-0f048f0eba66),SecurityGroupRule(e99acd94-5554-46f2-b953-a6cc37dc962d)],shared=False,stateful=True,updated_at=2022-09-27T04:31:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:51.485369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (9fc8c422-8c07-4d6a-a960-01299e4a0f02), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.486744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:51Z,description=,direction='ingress',ethertype='IPv4',id=079427ae-5504-43fd-ae27-87a8e0cd5cf6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9b4b56408d05473c8d33404de411de7b',protocol=,remote_address_group_id=,remote_group_id=9fc8c422-8c07-4d6a-a960-01299e4a0f02,remote_ip_prefix=,revision_number=0,security_group_id=9fc8c422-8c07-4d6a-a960-01299e4a0f02,updated_at=2022-09-27T04:31:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:51.487192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (079427ae-5504-43fd-ae27-87a8e0cd5cf6), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.487604 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Security group rule updated ['9fc8c422-8c07-4d6a-a960-01299e4a0f02'] Sep 27 04:31:51.488340 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:51Z,description=,direction='egress',ethertype='IPv6',id=a8a71cbc-1649-4ed0-ba2f-1f02c6443f40,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9b4b56408d05473c8d33404de411de7b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9fc8c422-8c07-4d6a-a960-01299e4a0f02,updated_at=2022-09-27T04:31:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:51.488759 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (a8a71cbc-1649-4ed0-ba2f-1f02c6443f40), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.489154 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Security group rule updated ['9fc8c422-8c07-4d6a-a960-01299e4a0f02'] Sep 27 04:31:51.489953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:51Z,description=,direction='ingress',ethertype='IPv6',id=cee545c6-056f-4289-8e3c-0f048f0eba66,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9b4b56408d05473c8d33404de411de7b',protocol=,remote_address_group_id=,remote_group_id=9fc8c422-8c07-4d6a-a960-01299e4a0f02,remote_ip_prefix=,revision_number=0,security_group_id=9fc8c422-8c07-4d6a-a960-01299e4a0f02,updated_at=2022-09-27T04:31:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:51.490380 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cee545c6-056f-4289-8e3c-0f048f0eba66), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.490785 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Security group rule updated ['9fc8c422-8c07-4d6a-a960-01299e4a0f02'] Sep 27 04:31:51.491525 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:51Z,description=,direction='egress',ethertype='IPv4',id=e99acd94-5554-46f2-b953-a6cc37dc962d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9b4b56408d05473c8d33404de411de7b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9fc8c422-8c07-4d6a-a960-01299e4a0f02,updated_at=2022-09-27T04:31:51Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:51.491940 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e99acd94-5554-46f2-b953-a6cc37dc962d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.492276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-e4f55534-b653-457d-960e-c33611f890ad admin admin] Security group rule updated ['9fc8c422-8c07-4d6a-a960-01299e4a0f02'] Sep 27 04:31:51.611771 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Resource SecurityGroup deleted: 9fc8c422-8c07-4d6a-a960-01299e4a0f02 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:51.612253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (9fc8c422-8c07-4d6a-a960-01299e4a0f02), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.612805 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9fc8c422-8c07-4d6a-a960-01299e4a0f02',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:31:51.625471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9fc8c422-8c07-4d6a-a960-01299e4a0f02',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:31:51.625948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Resource SecurityGroupRule deleted: 079427ae-5504-43fd-ae27-87a8e0cd5cf6 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:51.626325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (079427ae-5504-43fd-ae27-87a8e0cd5cf6), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.626704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Security group rule updated ['9fc8c422-8c07-4d6a-a960-01299e4a0f02'] Sep 27 04:31:51.627098 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Resource SecurityGroupRule deleted: a8a71cbc-1649-4ed0-ba2f-1f02c6443f40 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:51.627450 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (a8a71cbc-1649-4ed0-ba2f-1f02c6443f40), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.627775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Security group rule updated ['9fc8c422-8c07-4d6a-a960-01299e4a0f02'] Sep 27 04:31:51.628149 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Resource SecurityGroupRule deleted: cee545c6-056f-4289-8e3c-0f048f0eba66 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:51.628511 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cee545c6-056f-4289-8e3c-0f048f0eba66), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.628846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Security group rule updated ['9fc8c422-8c07-4d6a-a960-01299e4a0f02'] Sep 27 04:31:51.629219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Resource SecurityGroupRule deleted: e99acd94-5554-46f2-b953-a6cc37dc962d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:51.629561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e99acd94-5554-46f2-b953-a6cc37dc962d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:51.629905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5b996c27-df87-46e8-82be-047c043aa224 admin admin] Security group rule updated ['9fc8c422-8c07-4d6a-a960-01299e4a0f02'] Sep 27 04:31:51.876900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:594 started Sep 27 04:31:51.879291 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f47,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=703000000,duration_sec=1201,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:51.879866 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:51.880442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:594 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:31:53.821538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:31:53Z,description='Default security group',id=9994fc62-17c8-4493-b08b-7d76186102ec,is_default=True,name='default',project_id='b90ca78e4258450eb59c8bcd7053c118',revision_number=1,rules=[SecurityGroupRule(1bafc367-ca1a-41d5-9f3a-692f7b36c6f3),SecurityGroupRule(cfd3900e-91e4-4194-b2b3-7987de607532),SecurityGroupRule(e395fd1e-6d14-480e-8264-ed0c72c2c38a),SecurityGroupRule(fa9651d6-c69d-49b9-a539-9b5f9dadfd53)],shared=False,stateful=True,updated_at=2022-09-27T04:31:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:53.822396 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (9994fc62-17c8-4493-b08b-7d76186102ec), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:53.822589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:53Z,description=,direction='ingress',ethertype='IPv4',id=1bafc367-ca1a-41d5-9f3a-692f7b36c6f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b90ca78e4258450eb59c8bcd7053c118',protocol=,remote_address_group_id=,remote_group_id=9994fc62-17c8-4493-b08b-7d76186102ec,remote_ip_prefix=,revision_number=0,security_group_id=9994fc62-17c8-4493-b08b-7d76186102ec,updated_at=2022-09-27T04:31:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:53.822892 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1bafc367-ca1a-41d5-9f3a-692f7b36c6f3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:53.823225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Security group rule updated ['9994fc62-17c8-4493-b08b-7d76186102ec'] Sep 27 04:31:53.823905 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:53Z,description=,direction='egress',ethertype='IPv6',id=cfd3900e-91e4-4194-b2b3-7987de607532,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b90ca78e4258450eb59c8bcd7053c118',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9994fc62-17c8-4493-b08b-7d76186102ec,updated_at=2022-09-27T04:31:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:53.824311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cfd3900e-91e4-4194-b2b3-7987de607532), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:53.824639 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Security group rule updated ['9994fc62-17c8-4493-b08b-7d76186102ec'] Sep 27 04:31:53.825315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:53Z,description=,direction='ingress',ethertype='IPv6',id=e395fd1e-6d14-480e-8264-ed0c72c2c38a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b90ca78e4258450eb59c8bcd7053c118',protocol=,remote_address_group_id=,remote_group_id=9994fc62-17c8-4493-b08b-7d76186102ec,remote_ip_prefix=,revision_number=0,security_group_id=9994fc62-17c8-4493-b08b-7d76186102ec,updated_at=2022-09-27T04:31:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:53.825660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e395fd1e-6d14-480e-8264-ed0c72c2c38a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:53.827271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Security group rule updated ['9994fc62-17c8-4493-b08b-7d76186102ec'] Sep 27 04:31:53.827271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:53Z,description=,direction='egress',ethertype='IPv4',id=fa9651d6-c69d-49b9-a539-9b5f9dadfd53,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b90ca78e4258450eb59c8bcd7053c118',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9994fc62-17c8-4493-b08b-7d76186102ec,updated_at=2022-09-27T04:31:53Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:53.827271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (fa9651d6-c69d-49b9-a539-9b5f9dadfd53), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:53.827271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-78374e6d-f04f-41ff-abfe-98751b23402e admin admin] Security group rule updated ['9994fc62-17c8-4493-b08b-7d76186102ec'] Sep 27 04:31:53.878008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:595 started Sep 27 04:31:53.884403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f49,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=705000000,duration_sec=1203,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:53.884990 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:53.885342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:595 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:31:53.956538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Resource SecurityGroup deleted: 9994fc62-17c8-4493-b08b-7d76186102ec {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:53.957181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (9994fc62-17c8-4493-b08b-7d76186102ec), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:53.957955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9994fc62-17c8-4493-b08b-7d76186102ec',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:31:53.977199 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9994fc62-17c8-4493-b08b-7d76186102ec',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:31:53.977773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Resource SecurityGroupRule deleted: 1bafc367-ca1a-41d5-9f3a-692f7b36c6f3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:53.978223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1bafc367-ca1a-41d5-9f3a-692f7b36c6f3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:53.978635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Security group rule updated ['9994fc62-17c8-4493-b08b-7d76186102ec'] Sep 27 04:31:53.979105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Resource SecurityGroupRule deleted: cfd3900e-91e4-4194-b2b3-7987de607532 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:53.979523 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cfd3900e-91e4-4194-b2b3-7987de607532), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:53.979913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Security group rule updated ['9994fc62-17c8-4493-b08b-7d76186102ec'] Sep 27 04:31:53.980730 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Resource SecurityGroupRule deleted: e395fd1e-6d14-480e-8264-ed0c72c2c38a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:53.981440 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e395fd1e-6d14-480e-8264-ed0c72c2c38a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:53.982124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Security group rule updated ['9994fc62-17c8-4493-b08b-7d76186102ec'] Sep 27 04:31:53.982796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Resource SecurityGroupRule deleted: fa9651d6-c69d-49b9-a539-9b5f9dadfd53 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:53.983449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (fa9651d6-c69d-49b9-a539-9b5f9dadfd53), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:53.983993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8161f898-a234-4f00-9e80-1b913bd57144 admin admin] Security group rule updated ['9994fc62-17c8-4493-b08b-7d76186102ec'] Sep 27 04:31:54.378943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:31:54Z,description='Default security group',id=fe56b169-8d12-4ef3-a8d6-8289e18dbbf7,is_default=True,name='default',project_id='59ce799c6ecc4e72819d87324d89a8c6',revision_number=1,rules=[SecurityGroupRule(08fdd49c-ee84-40ab-b278-487a9500e8c7),SecurityGroupRule(629f5d4a-60d9-4bd1-96c9-35f8fa24755d),SecurityGroupRule(aadbc9ad-3984-46d7-8a9b-f03f575583ac),SecurityGroupRule(e7b10ebc-63a8-474b-ac6b-b6b1b9ad52cb)],shared=False,stateful=True,updated_at=2022-09-27T04:31:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:54.379398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (fe56b169-8d12-4ef3-a8d6-8289e18dbbf7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:54.380033 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:54Z,description=,direction='ingress',ethertype='IPv4',id=08fdd49c-ee84-40ab-b278-487a9500e8c7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59ce799c6ecc4e72819d87324d89a8c6',protocol=,remote_address_group_id=,remote_group_id=fe56b169-8d12-4ef3-a8d6-8289e18dbbf7,remote_ip_prefix=,revision_number=0,security_group_id=fe56b169-8d12-4ef3-a8d6-8289e18dbbf7,updated_at=2022-09-27T04:31:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:54.380527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (08fdd49c-ee84-40ab-b278-487a9500e8c7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:54.380873 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Security group rule updated ['fe56b169-8d12-4ef3-a8d6-8289e18dbbf7'] Sep 27 04:31:54.381579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:54Z,description=,direction='egress',ethertype='IPv4',id=629f5d4a-60d9-4bd1-96c9-35f8fa24755d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59ce799c6ecc4e72819d87324d89a8c6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fe56b169-8d12-4ef3-a8d6-8289e18dbbf7,updated_at=2022-09-27T04:31:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:54.381980 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (629f5d4a-60d9-4bd1-96c9-35f8fa24755d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:54.382342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Security group rule updated ['fe56b169-8d12-4ef3-a8d6-8289e18dbbf7'] Sep 27 04:31:54.383035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:54Z,description=,direction='ingress',ethertype='IPv6',id=aadbc9ad-3984-46d7-8a9b-f03f575583ac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59ce799c6ecc4e72819d87324d89a8c6',protocol=,remote_address_group_id=,remote_group_id=fe56b169-8d12-4ef3-a8d6-8289e18dbbf7,remote_ip_prefix=,revision_number=0,security_group_id=fe56b169-8d12-4ef3-a8d6-8289e18dbbf7,updated_at=2022-09-27T04:31:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:54.383393 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (aadbc9ad-3984-46d7-8a9b-f03f575583ac), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:54.383726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Security group rule updated ['fe56b169-8d12-4ef3-a8d6-8289e18dbbf7'] Sep 27 04:31:54.384381 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:54Z,description=,direction='egress',ethertype='IPv6',id=e7b10ebc-63a8-474b-ac6b-b6b1b9ad52cb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59ce799c6ecc4e72819d87324d89a8c6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fe56b169-8d12-4ef3-a8d6-8289e18dbbf7,updated_at=2022-09-27T04:31:54Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:54.384739 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (e7b10ebc-63a8-474b-ac6b-b6b1b9ad52cb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:54.385069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ba9b0539-44be-4476-b9af-755ac1382b71 admin admin] Security group rule updated ['fe56b169-8d12-4ef3-a8d6-8289e18dbbf7'] Sep 27 04:31:54.517669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Resource SecurityGroup deleted: fe56b169-8d12-4ef3-a8d6-8289e18dbbf7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:54.518138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (fe56b169-8d12-4ef3-a8d6-8289e18dbbf7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:54.518692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fe56b169-8d12-4ef3-a8d6-8289e18dbbf7',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:31:54.531294 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fe56b169-8d12-4ef3-a8d6-8289e18dbbf7',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:31:54.531731 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Resource SecurityGroupRule deleted: 08fdd49c-ee84-40ab-b278-487a9500e8c7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:54.532097 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (08fdd49c-ee84-40ab-b278-487a9500e8c7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:54.532470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Security group rule updated ['fe56b169-8d12-4ef3-a8d6-8289e18dbbf7'] Sep 27 04:31:54.532866 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Resource SecurityGroupRule deleted: 629f5d4a-60d9-4bd1-96c9-35f8fa24755d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:54.533214 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (629f5d4a-60d9-4bd1-96c9-35f8fa24755d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:54.533536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Security group rule updated ['fe56b169-8d12-4ef3-a8d6-8289e18dbbf7'] Sep 27 04:31:54.533944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Resource SecurityGroupRule deleted: aadbc9ad-3984-46d7-8a9b-f03f575583ac {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:54.534289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (aadbc9ad-3984-46d7-8a9b-f03f575583ac), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:54.534605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Security group rule updated ['fe56b169-8d12-4ef3-a8d6-8289e18dbbf7'] Sep 27 04:31:54.534973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Resource SecurityGroupRule deleted: e7b10ebc-63a8-474b-ac6b-b6b1b9ad52cb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:54.535311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (e7b10ebc-63a8-474b-ac6b-b6b1b9ad52cb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:54.535624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-b4400e64-234b-487e-83da-f7b3c50bd841 admin admin] Security group rule updated ['fe56b169-8d12-4ef3-a8d6-8289e18dbbf7'] Sep 27 04:31:55.781288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:31:55Z,description='Default security group',id=b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4,is_default=True,name='default',project_id='db1eef069b6f4ea1bbed2547506998c4',revision_number=1,rules=[SecurityGroupRule(1277cc2d-fde9-481b-b141-f439499305d4),SecurityGroupRule(1b07345a-475b-4f4e-a25f-3563c1b5dc3e),SecurityGroupRule(4d50c0d7-1bfb-4a56-a0a0-29d075edae65),SecurityGroupRule(d1de3fa4-eb7e-4305-9eae-68dc52d622bf)],shared=False,stateful=True,updated_at=2022-09-27T04:31:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:55.781875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:55.782609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:55Z,description=,direction='ingress',ethertype='IPv4',id=1277cc2d-fde9-481b-b141-f439499305d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db1eef069b6f4ea1bbed2547506998c4',protocol=,remote_address_group_id=,remote_group_id=b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4,remote_ip_prefix=,revision_number=0,security_group_id=b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4,updated_at=2022-09-27T04:31:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:55.783062 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1277cc2d-fde9-481b-b141-f439499305d4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:55.783394 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Security group rule updated ['b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4'] Sep 27 04:31:55.784077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:55Z,description=,direction='ingress',ethertype='IPv6',id=1b07345a-475b-4f4e-a25f-3563c1b5dc3e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db1eef069b6f4ea1bbed2547506998c4',protocol=,remote_address_group_id=,remote_group_id=b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4,remote_ip_prefix=,revision_number=0,security_group_id=b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4,updated_at=2022-09-27T04:31:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:55.784437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1b07345a-475b-4f4e-a25f-3563c1b5dc3e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:55.784774 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Security group rule updated ['b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4'] Sep 27 04:31:55.785435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:55Z,description=,direction='egress',ethertype='IPv4',id=4d50c0d7-1bfb-4a56-a0a0-29d075edae65,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db1eef069b6f4ea1bbed2547506998c4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4,updated_at=2022-09-27T04:31:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:55.785846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4d50c0d7-1bfb-4a56-a0a0-29d075edae65), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:55.786185 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Security group rule updated ['b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4'] Sep 27 04:31:55.786875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:31:55Z,description=,direction='egress',ethertype='IPv6',id=d1de3fa4-eb7e-4305-9eae-68dc52d622bf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db1eef069b6f4ea1bbed2547506998c4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4,updated_at=2022-09-27T04:31:55Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:31:55.787232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d1de3fa4-eb7e-4305-9eae-68dc52d622bf), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:55.787564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ede2a944-c8ea-46ee-98cb-3db0b2245ee8 admin admin] Security group rule updated ['b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4'] Sep 27 04:31:55.878649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:596 started Sep 27 04:31:55.881907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f4b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=706000000,duration_sec=1205,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:55.882702 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:55.883312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:596 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:31:55.910247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Resource SecurityGroup deleted: b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:55.910648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:55.911105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:31:55.925174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:31:55.925635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Resource SecurityGroupRule deleted: 1277cc2d-fde9-481b-b141-f439499305d4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:55.926022 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1277cc2d-fde9-481b-b141-f439499305d4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:55.926389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Security group rule updated ['b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4'] Sep 27 04:31:55.926732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Resource SecurityGroupRule deleted: 1b07345a-475b-4f4e-a25f-3563c1b5dc3e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:55.927074 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1b07345a-475b-4f4e-a25f-3563c1b5dc3e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:55.927390 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Security group rule updated ['b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4'] Sep 27 04:31:55.927758 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Resource SecurityGroupRule deleted: 4d50c0d7-1bfb-4a56-a0a0-29d075edae65 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:55.928097 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4d50c0d7-1bfb-4a56-a0a0-29d075edae65), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:55.928407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Security group rule updated ['b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4'] Sep 27 04:31:55.928773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Resource SecurityGroupRule deleted: d1de3fa4-eb7e-4305-9eae-68dc52d622bf {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:31:55.929134 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d1de3fa4-eb7e-4305-9eae-68dc52d622bf), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:31:55.929447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-16630712-4407-4fb5-981c-231d3822e70e admin admin] Security group rule updated ['b8a3f77d-2e3e-4e8f-9a02-1a24474ffaa4'] Sep 27 04:31:57.879939 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:597 started Sep 27 04:31:57.885108 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f4d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=707000000,duration_sec=1207,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:57.885683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:57.886064 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:597 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:31:59.881151 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:598 started Sep 27 04:31:59.883810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f4f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=708000000,duration_sec=1209,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:31:59.884484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:31:59.884835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:598 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:00.166017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:32:00Z,description='Default security group',id=8ef119ec-889a-4906-9b48-5cd059567207,is_default=True,name='default',project_id='3e170049f0bc4a6ba4c4b513591e053c',revision_number=1,rules=[SecurityGroupRule(b9b1bd68-d39c-48fb-9f88-aec05751d539),SecurityGroupRule(bede0dee-fa5f-42cd-bd5e-94d95feeaa0d),SecurityGroupRule(c255c693-4920-4131-82aa-4f67b4c4b9ad),SecurityGroupRule(f213b900-7cac-4856-9158-15f7779d75fb)],shared=False,stateful=True,updated_at=2022-09-27T04:32:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:00.166410 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (8ef119ec-889a-4906-9b48-5cd059567207), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.167069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:00Z,description=,direction='egress',ethertype='IPv4',id=b9b1bd68-d39c-48fb-9f88-aec05751d539,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3e170049f0bc4a6ba4c4b513591e053c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8ef119ec-889a-4906-9b48-5cd059567207,updated_at=2022-09-27T04:32:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:00.167437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b9b1bd68-d39c-48fb-9f88-aec05751d539), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.167776 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Security group rule updated ['8ef119ec-889a-4906-9b48-5cd059567207'] Sep 27 04:32:00.168458 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:00Z,description=,direction='ingress',ethertype='IPv6',id=bede0dee-fa5f-42cd-bd5e-94d95feeaa0d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3e170049f0bc4a6ba4c4b513591e053c',protocol=,remote_address_group_id=,remote_group_id=8ef119ec-889a-4906-9b48-5cd059567207,remote_ip_prefix=,revision_number=0,security_group_id=8ef119ec-889a-4906-9b48-5cd059567207,updated_at=2022-09-27T04:32:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:00.168823 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (bede0dee-fa5f-42cd-bd5e-94d95feeaa0d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.169156 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Security group rule updated ['8ef119ec-889a-4906-9b48-5cd059567207'] Sep 27 04:32:00.169843 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:00Z,description=,direction='ingress',ethertype='IPv4',id=c255c693-4920-4131-82aa-4f67b4c4b9ad,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3e170049f0bc4a6ba4c4b513591e053c',protocol=,remote_address_group_id=,remote_group_id=8ef119ec-889a-4906-9b48-5cd059567207,remote_ip_prefix=,revision_number=0,security_group_id=8ef119ec-889a-4906-9b48-5cd059567207,updated_at=2022-09-27T04:32:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:00.170200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (c255c693-4920-4131-82aa-4f67b4c4b9ad), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.170534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Security group rule updated ['8ef119ec-889a-4906-9b48-5cd059567207'] Sep 27 04:32:00.171186 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:00Z,description=,direction='egress',ethertype='IPv6',id=f213b900-7cac-4856-9158-15f7779d75fb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3e170049f0bc4a6ba4c4b513591e053c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8ef119ec-889a-4906-9b48-5cd059567207,updated_at=2022-09-27T04:32:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:00.171541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f213b900-7cac-4856-9158-15f7779d75fb), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.171911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-ede01d6e-d30f-4fa7-a833-6936c31e8d18 admin admin] Security group rule updated ['8ef119ec-889a-4906-9b48-5cd059567207'] Sep 27 04:32:00.294350 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Resource SecurityGroup deleted: 8ef119ec-889a-4906-9b48-5cd059567207 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:00.294755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (8ef119ec-889a-4906-9b48-5cd059567207), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.295222 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8ef119ec-889a-4906-9b48-5cd059567207',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:32:00.307143 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8ef119ec-889a-4906-9b48-5cd059567207',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:32:00.307762 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Resource SecurityGroupRule deleted: b9b1bd68-d39c-48fb-9f88-aec05751d539 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:00.308232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b9b1bd68-d39c-48fb-9f88-aec05751d539), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.308696 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Security group rule updated ['8ef119ec-889a-4906-9b48-5cd059567207'] Sep 27 04:32:00.309255 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Resource SecurityGroupRule deleted: bede0dee-fa5f-42cd-bd5e-94d95feeaa0d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:00.309720 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (bede0dee-fa5f-42cd-bd5e-94d95feeaa0d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.310210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Security group rule updated ['8ef119ec-889a-4906-9b48-5cd059567207'] Sep 27 04:32:00.310686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Resource SecurityGroupRule deleted: c255c693-4920-4131-82aa-4f67b4c4b9ad {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:00.311216 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c255c693-4920-4131-82aa-4f67b4c4b9ad), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.311639 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Security group rule updated ['8ef119ec-889a-4906-9b48-5cd059567207'] Sep 27 04:32:00.312083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Resource SecurityGroupRule deleted: f213b900-7cac-4856-9158-15f7779d75fb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:00.313012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f213b900-7cac-4856-9158-15f7779d75fb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.313453 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7cdfa003-bff9-4076-b71a-96b7f606028e admin admin] Security group rule updated ['8ef119ec-889a-4906-9b48-5cd059567207'] Sep 27 04:32:00.681564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:32:00Z,description='Default security group',id=42cf0843-7d81-4905-9b09-d390192ea0ab,is_default=True,name='default',project_id='27ffb402f2904efe87077e4d1ff8c091',revision_number=1,rules=[SecurityGroupRule(2ffde680-0971-4e9b-89f8-a8d9576e7530),SecurityGroupRule(36cd1bca-07cf-4ed8-a55a-be16225b5d68),SecurityGroupRule(4d8fe8b3-25ea-41c1-a278-e67bd14979c1),SecurityGroupRule(d4014826-6dab-4a68-82a3-509694c2de78)],shared=False,stateful=True,updated_at=2022-09-27T04:32:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:00.681972 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (42cf0843-7d81-4905-9b09-d390192ea0ab), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.682690 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:00Z,description=,direction='egress',ethertype='IPv6',id=2ffde680-0971-4e9b-89f8-a8d9576e7530,normalized_cidr=None,port_range_max=,port_range_min=,project_id='27ffb402f2904efe87077e4d1ff8c091',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42cf0843-7d81-4905-9b09-d390192ea0ab,updated_at=2022-09-27T04:32:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:00.683089 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2ffde680-0971-4e9b-89f8-a8d9576e7530), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.683432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Security group rule updated ['42cf0843-7d81-4905-9b09-d390192ea0ab'] Sep 27 04:32:00.684109 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:00Z,description=,direction='ingress',ethertype='IPv6',id=36cd1bca-07cf-4ed8-a55a-be16225b5d68,normalized_cidr=None,port_range_max=,port_range_min=,project_id='27ffb402f2904efe87077e4d1ff8c091',protocol=,remote_address_group_id=,remote_group_id=42cf0843-7d81-4905-9b09-d390192ea0ab,remote_ip_prefix=,revision_number=0,security_group_id=42cf0843-7d81-4905-9b09-d390192ea0ab,updated_at=2022-09-27T04:32:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:00.684464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (36cd1bca-07cf-4ed8-a55a-be16225b5d68), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.684795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Security group rule updated ['42cf0843-7d81-4905-9b09-d390192ea0ab'] Sep 27 04:32:00.685487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:00Z,description=,direction='ingress',ethertype='IPv4',id=4d8fe8b3-25ea-41c1-a278-e67bd14979c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='27ffb402f2904efe87077e4d1ff8c091',protocol=,remote_address_group_id=,remote_group_id=42cf0843-7d81-4905-9b09-d390192ea0ab,remote_ip_prefix=,revision_number=0,security_group_id=42cf0843-7d81-4905-9b09-d390192ea0ab,updated_at=2022-09-27T04:32:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:00.685860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (4d8fe8b3-25ea-41c1-a278-e67bd14979c1), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.686188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Security group rule updated ['42cf0843-7d81-4905-9b09-d390192ea0ab'] Sep 27 04:32:00.686839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:00Z,description=,direction='egress',ethertype='IPv4',id=d4014826-6dab-4a68-82a3-509694c2de78,normalized_cidr=None,port_range_max=,port_range_min=,project_id='27ffb402f2904efe87077e4d1ff8c091',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42cf0843-7d81-4905-9b09-d390192ea0ab,updated_at=2022-09-27T04:32:00Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:00.687191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d4014826-6dab-4a68-82a3-509694c2de78), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.687549 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-dd627a2d-ee5b-406c-8234-40414f64d3ed admin admin] Security group rule updated ['42cf0843-7d81-4905-9b09-d390192ea0ab'] Sep 27 04:32:00.806424 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Resource SecurityGroup deleted: 42cf0843-7d81-4905-9b09-d390192ea0ab {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:00.806889 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (42cf0843-7d81-4905-9b09-d390192ea0ab), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.807405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('42cf0843-7d81-4905-9b09-d390192ea0ab',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:32:00.820696 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('42cf0843-7d81-4905-9b09-d390192ea0ab',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:32:00.821138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Resource SecurityGroupRule deleted: 2ffde680-0971-4e9b-89f8-a8d9576e7530 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:00.821508 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2ffde680-0971-4e9b-89f8-a8d9576e7530), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.822054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Security group rule updated ['42cf0843-7d81-4905-9b09-d390192ea0ab'] Sep 27 04:32:00.822483 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Resource SecurityGroupRule deleted: 36cd1bca-07cf-4ed8-a55a-be16225b5d68 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:00.823321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (36cd1bca-07cf-4ed8-a55a-be16225b5d68), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.823663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Security group rule updated ['42cf0843-7d81-4905-9b09-d390192ea0ab'] Sep 27 04:32:00.824041 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Resource SecurityGroupRule deleted: 4d8fe8b3-25ea-41c1-a278-e67bd14979c1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:00.824388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (4d8fe8b3-25ea-41c1-a278-e67bd14979c1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.824713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Security group rule updated ['42cf0843-7d81-4905-9b09-d390192ea0ab'] Sep 27 04:32:00.825083 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Resource SecurityGroupRule deleted: d4014826-6dab-4a68-82a3-509694c2de78 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:00.825429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d4014826-6dab-4a68-82a3-509694c2de78), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:00.825767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8818845c-d716-4588-8575-04c6b2f028dd admin admin] Security group rule updated ['42cf0843-7d81-4905-9b09-d390192ea0ab'] Sep 27 04:32:01.882459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:599 started Sep 27 04:32:01.885736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=710000000,duration_sec=1211,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:01.886572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:01.886872 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:599 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:32:03.883786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:600 started Sep 27 04:32:03.886492 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f53,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=710000000,duration_sec=1213,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:03.887066 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:03.887421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:600 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:05.884783 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:601 started Sep 27 04:32:05.887203 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f55,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=711000000,duration_sec=1215,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:05.888134 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:05.888486 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:601 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:07.886103 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:602 started Sep 27 04:32:07.888521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f57,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=713000000,duration_sec=1217,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:07.889506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:07.889898 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:602 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:09.327651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:32:09Z,description='Default security group',id=cb1f20ca-b93b-4468-8340-88b706e02eb2,is_default=True,name='default',project_id='710392938fb8429b991aab0d48faf1d7',revision_number=1,rules=[SecurityGroupRule(0cd97fdc-fbeb-43c7-aaf8-3ab92ee0c429),SecurityGroupRule(78f5901c-730d-401a-afd5-d7cfc2a3a92a),SecurityGroupRule(989810bc-6883-4c0a-a96c-d080c4cfa6d3),SecurityGroupRule(f8440399-3875-49aa-9c6a-ca051a8cc7b2)],shared=False,stateful=True,updated_at=2022-09-27T04:32:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:09.328195 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (cb1f20ca-b93b-4468-8340-88b706e02eb2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.328744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:09Z,description=,direction='egress',ethertype='IPv4',id=0cd97fdc-fbeb-43c7-aaf8-3ab92ee0c429,normalized_cidr=None,port_range_max=,port_range_min=,project_id='710392938fb8429b991aab0d48faf1d7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb1f20ca-b93b-4468-8340-88b706e02eb2,updated_at=2022-09-27T04:32:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:09.329218 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (0cd97fdc-fbeb-43c7-aaf8-3ab92ee0c429), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.329617 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Security group rule updated ['cb1f20ca-b93b-4468-8340-88b706e02eb2'] Sep 27 04:32:09.330320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:09Z,description=,direction='ingress',ethertype='IPv6',id=78f5901c-730d-401a-afd5-d7cfc2a3a92a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='710392938fb8429b991aab0d48faf1d7',protocol=,remote_address_group_id=,remote_group_id=cb1f20ca-b93b-4468-8340-88b706e02eb2,remote_ip_prefix=,revision_number=0,security_group_id=cb1f20ca-b93b-4468-8340-88b706e02eb2,updated_at=2022-09-27T04:32:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:09.330673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (78f5901c-730d-401a-afd5-d7cfc2a3a92a), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.331003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Security group rule updated ['cb1f20ca-b93b-4468-8340-88b706e02eb2'] Sep 27 04:32:09.331656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:09Z,description=,direction='ingress',ethertype='IPv4',id=989810bc-6883-4c0a-a96c-d080c4cfa6d3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='710392938fb8429b991aab0d48faf1d7',protocol=,remote_address_group_id=,remote_group_id=cb1f20ca-b93b-4468-8340-88b706e02eb2,remote_ip_prefix=,revision_number=0,security_group_id=cb1f20ca-b93b-4468-8340-88b706e02eb2,updated_at=2022-09-27T04:32:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:09.332007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (989810bc-6883-4c0a-a96c-d080c4cfa6d3), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.332335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Security group rule updated ['cb1f20ca-b93b-4468-8340-88b706e02eb2'] Sep 27 04:32:09.333036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:09Z,description=,direction='egress',ethertype='IPv6',id=f8440399-3875-49aa-9c6a-ca051a8cc7b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='710392938fb8429b991aab0d48faf1d7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb1f20ca-b93b-4468-8340-88b706e02eb2,updated_at=2022-09-27T04:32:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:09.333385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f8440399-3875-49aa-9c6a-ca051a8cc7b2), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.333731 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-5e9dc3c1-6baf-4fef-9345-191e3ea90cd3 admin admin] Security group rule updated ['cb1f20ca-b93b-4468-8340-88b706e02eb2'] Sep 27 04:32:09.452234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Resource SecurityGroup deleted: cb1f20ca-b93b-4468-8340-88b706e02eb2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:09.452614 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (cb1f20ca-b93b-4468-8340-88b706e02eb2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.453060 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cb1f20ca-b93b-4468-8340-88b706e02eb2',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:32:09.466013 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cb1f20ca-b93b-4468-8340-88b706e02eb2',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:32:09.466448 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Resource SecurityGroupRule deleted: 0cd97fdc-fbeb-43c7-aaf8-3ab92ee0c429 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:09.466809 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (0cd97fdc-fbeb-43c7-aaf8-3ab92ee0c429), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.467744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Security group rule updated ['cb1f20ca-b93b-4468-8340-88b706e02eb2'] Sep 27 04:32:09.468233 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Resource SecurityGroupRule deleted: 78f5901c-730d-401a-afd5-d7cfc2a3a92a {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:09.468610 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (78f5901c-730d-401a-afd5-d7cfc2a3a92a), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.468930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Security group rule updated ['cb1f20ca-b93b-4468-8340-88b706e02eb2'] Sep 27 04:32:09.469326 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Resource SecurityGroupRule deleted: 989810bc-6883-4c0a-a96c-d080c4cfa6d3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:09.469685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (989810bc-6883-4c0a-a96c-d080c4cfa6d3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.470024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Security group rule updated ['cb1f20ca-b93b-4468-8340-88b706e02eb2'] Sep 27 04:32:09.470388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Resource SecurityGroupRule deleted: f8440399-3875-49aa-9c6a-ca051a8cc7b2 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:09.470749 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f8440399-3875-49aa-9c6a-ca051a8cc7b2), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.471059 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-9da7336c-f7ae-4b05-94cc-d56e324efa3c admin admin] Security group rule updated ['cb1f20ca-b93b-4468-8340-88b706e02eb2'] Sep 27 04:32:09.849769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:32:09Z,description='Default security group',id=8a5bf992-1036-44ac-ab42-a86c57ac4a41,is_default=True,name='default',project_id='425a74f118684dc3951c7dd4df7bb3c1',revision_number=1,rules=[SecurityGroupRule(042a6d00-81ce-462a-a487-bad06b496ede),SecurityGroupRule(cbdbc3de-7f41-44e5-9284-62381ae17a1b),SecurityGroupRule(d9945ac1-b74a-4f00-8025-b738e1ca5976),SecurityGroupRule(f91ddf9b-29e2-4a13-bc08-a19f03c1fbc4)],shared=False,stateful=True,updated_at=2022-09-27T04:32:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:09.850286 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (8a5bf992-1036-44ac-ab42-a86c57ac4a41), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.850999 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:09Z,description=,direction='egress',ethertype='IPv4',id=042a6d00-81ce-462a-a487-bad06b496ede,normalized_cidr=None,port_range_max=,port_range_min=,project_id='425a74f118684dc3951c7dd4df7bb3c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8a5bf992-1036-44ac-ab42-a86c57ac4a41,updated_at=2022-09-27T04:32:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:09.851482 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (042a6d00-81ce-462a-a487-bad06b496ede), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.851933 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Security group rule updated ['8a5bf992-1036-44ac-ab42-a86c57ac4a41'] Sep 27 04:32:09.853210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:09Z,description=,direction='ingress',ethertype='IPv6',id=cbdbc3de-7f41-44e5-9284-62381ae17a1b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='425a74f118684dc3951c7dd4df7bb3c1',protocol=,remote_address_group_id=,remote_group_id=8a5bf992-1036-44ac-ab42-a86c57ac4a41,remote_ip_prefix=,revision_number=0,security_group_id=8a5bf992-1036-44ac-ab42-a86c57ac4a41,updated_at=2022-09-27T04:32:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:09.853694 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (cbdbc3de-7f41-44e5-9284-62381ae17a1b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.854144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Security group rule updated ['8a5bf992-1036-44ac-ab42-a86c57ac4a41'] Sep 27 04:32:09.854819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:09Z,description=,direction='ingress',ethertype='IPv4',id=d9945ac1-b74a-4f00-8025-b738e1ca5976,normalized_cidr=None,port_range_max=,port_range_min=,project_id='425a74f118684dc3951c7dd4df7bb3c1',protocol=,remote_address_group_id=,remote_group_id=8a5bf992-1036-44ac-ab42-a86c57ac4a41,remote_ip_prefix=,revision_number=0,security_group_id=8a5bf992-1036-44ac-ab42-a86c57ac4a41,updated_at=2022-09-27T04:32:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:09.855173 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (d9945ac1-b74a-4f00-8025-b738e1ca5976), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.855502 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Security group rule updated ['8a5bf992-1036-44ac-ab42-a86c57ac4a41'] Sep 27 04:32:09.856150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:09Z,description=,direction='egress',ethertype='IPv6',id=f91ddf9b-29e2-4a13-bc08-a19f03c1fbc4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='425a74f118684dc3951c7dd4df7bb3c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8a5bf992-1036-44ac-ab42-a86c57ac4a41,updated_at=2022-09-27T04:32:09Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:09.856500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (f91ddf9b-29e2-4a13-bc08-a19f03c1fbc4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.856824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-8ad9a524-e20b-4504-8e57-0f59afd84622 admin admin] Security group rule updated ['8a5bf992-1036-44ac-ab42-a86c57ac4a41'] Sep 27 04:32:09.887305 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:603 started Sep 27 04:32:09.889640 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f59,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=714000000,duration_sec=1219,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:09.890600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:09.890952 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:603 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:09.980902 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Resource SecurityGroup deleted: 8a5bf992-1036-44ac-ab42-a86c57ac4a41 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:09.981346 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (8a5bf992-1036-44ac-ab42-a86c57ac4a41), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.981888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8a5bf992-1036-44ac-ab42-a86c57ac4a41',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:32:09.995343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8a5bf992-1036-44ac-ab42-a86c57ac4a41',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:32:09.995965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Resource SecurityGroupRule deleted: 042a6d00-81ce-462a-a487-bad06b496ede {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:09.996335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (042a6d00-81ce-462a-a487-bad06b496ede), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.997138 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Security group rule updated ['8a5bf992-1036-44ac-ab42-a86c57ac4a41'] Sep 27 04:32:09.997545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Resource SecurityGroupRule deleted: cbdbc3de-7f41-44e5-9284-62381ae17a1b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:09.997939 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (cbdbc3de-7f41-44e5-9284-62381ae17a1b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:09.998959 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Security group rule updated ['8a5bf992-1036-44ac-ab42-a86c57ac4a41'] Sep 27 04:32:09.999341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Resource SecurityGroupRule deleted: d9945ac1-b74a-4f00-8025-b738e1ca5976 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:09.999686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (d9945ac1-b74a-4f00-8025-b738e1ca5976), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.000178 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Security group rule updated ['8a5bf992-1036-44ac-ab42-a86c57ac4a41'] Sep 27 04:32:10.000767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Resource SecurityGroupRule deleted: f91ddf9b-29e2-4a13-bc08-a19f03c1fbc4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:10.000882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f91ddf9b-29e2-4a13-bc08-a19f03c1fbc4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.001199 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-6bc9a1a6-ea89-4cd3-a81f-0f9714735628 admin admin] Security group rule updated ['8a5bf992-1036-44ac-ab42-a86c57ac4a41'] Sep 27 04:32:10.432180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:32:10Z,description='Default security group',id=d222206c-5168-4f45-9aa8-aa7afffef550,is_default=True,name='default',project_id='0e062570862c4d3793aba5c24486c183',revision_number=1,rules=[SecurityGroupRule(2c1c5204-feea-44df-baa2-2ebed689bcb5),SecurityGroupRule(396f83f3-f8b6-4ae8-baf7-aae43235f9bf),SecurityGroupRule(9a31d0df-1432-4ef8-b895-4964b998f4d7),SecurityGroupRule(b878db70-0855-4165-939f-453e957f5a8d)],shared=False,stateful=True,updated_at=2022-09-27T04:32:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:10.432754 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (d222206c-5168-4f45-9aa8-aa7afffef550), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.433335 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:10Z,description=,direction='ingress',ethertype='IPv4',id=2c1c5204-feea-44df-baa2-2ebed689bcb5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0e062570862c4d3793aba5c24486c183',protocol=,remote_address_group_id=,remote_group_id=d222206c-5168-4f45-9aa8-aa7afffef550,remote_ip_prefix=,revision_number=0,security_group_id=d222206c-5168-4f45-9aa8-aa7afffef550,updated_at=2022-09-27T04:32:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:10.433846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2c1c5204-feea-44df-baa2-2ebed689bcb5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.434256 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Security group rule updated ['d222206c-5168-4f45-9aa8-aa7afffef550'] Sep 27 04:32:10.434999 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:10Z,description=,direction='egress',ethertype='IPv6',id=396f83f3-f8b6-4ae8-baf7-aae43235f9bf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0e062570862c4d3793aba5c24486c183',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d222206c-5168-4f45-9aa8-aa7afffef550,updated_at=2022-09-27T04:32:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:10.435635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (396f83f3-f8b6-4ae8-baf7-aae43235f9bf), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.436570 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Security group rule updated ['d222206c-5168-4f45-9aa8-aa7afffef550'] Sep 27 04:32:10.437429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:10Z,description=,direction='egress',ethertype='IPv4',id=9a31d0df-1432-4ef8-b895-4964b998f4d7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0e062570862c4d3793aba5c24486c183',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d222206c-5168-4f45-9aa8-aa7afffef550,updated_at=2022-09-27T04:32:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:10.437893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (9a31d0df-1432-4ef8-b895-4964b998f4d7), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.438441 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Security group rule updated ['d222206c-5168-4f45-9aa8-aa7afffef550'] Sep 27 04:32:10.439220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:10Z,description=,direction='ingress',ethertype='IPv6',id=b878db70-0855-4165-939f-453e957f5a8d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0e062570862c4d3793aba5c24486c183',protocol=,remote_address_group_id=,remote_group_id=d222206c-5168-4f45-9aa8-aa7afffef550,remote_ip_prefix=,revision_number=0,security_group_id=d222206c-5168-4f45-9aa8-aa7afffef550,updated_at=2022-09-27T04:32:10Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:10.439644 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (b878db70-0855-4165-939f-453e957f5a8d), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.440049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-21bf32d1-6028-4c23-b93a-5ac0f4e50c4c admin admin] Security group rule updated ['d222206c-5168-4f45-9aa8-aa7afffef550'] Sep 27 04:32:10.611942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Resource SecurityGroup deleted: d222206c-5168-4f45-9aa8-aa7afffef550 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:10.612371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (d222206c-5168-4f45-9aa8-aa7afffef550), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.613553 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d222206c-5168-4f45-9aa8-aa7afffef550',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:32:10.628472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d222206c-5168-4f45-9aa8-aa7afffef550',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:32:10.629459 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Resource SecurityGroupRule deleted: 2c1c5204-feea-44df-baa2-2ebed689bcb5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:10.629975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2c1c5204-feea-44df-baa2-2ebed689bcb5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.630610 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Security group rule updated ['d222206c-5168-4f45-9aa8-aa7afffef550'] Sep 27 04:32:10.631418 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Resource SecurityGroupRule deleted: 396f83f3-f8b6-4ae8-baf7-aae43235f9bf {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:10.632028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (396f83f3-f8b6-4ae8-baf7-aae43235f9bf), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.632554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Security group rule updated ['d222206c-5168-4f45-9aa8-aa7afffef550'] Sep 27 04:32:10.633116 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Resource SecurityGroupRule deleted: 9a31d0df-1432-4ef8-b895-4964b998f4d7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:10.633777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9a31d0df-1432-4ef8-b895-4964b998f4d7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.634343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Security group rule updated ['d222206c-5168-4f45-9aa8-aa7afffef550'] Sep 27 04:32:10.634950 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Resource SecurityGroupRule deleted: b878db70-0855-4165-939f-453e957f5a8d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:10.635699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b878db70-0855-4165-939f-453e957f5a8d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:10.636232 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-4fc6d379-63af-4e0c-a372-9406bd2bf979 admin admin] Security group rule updated ['d222206c-5168-4f45-9aa8-aa7afffef550'] Sep 27 04:32:11.495546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-27T04:32:11Z,description='Default security group',id=c7bcf143-e8dc-472e-9f7a-55fd2bac5488,is_default=True,name='default',project_id='494bdfe04cfa4dfab2c7ab389a889298',revision_number=1,rules=[SecurityGroupRule(1a8cef82-4e0d-4ca9-9e7b-445318217af5),SecurityGroupRule(2f42632f-cd3b-4cc8-95f9-d6239c34144b),SecurityGroupRule(6fe60e26-8ebb-4089-b219-a30af097301e),SecurityGroupRule(81c1a6c1-15a5-4873-95a9-d23a898e1bea)],shared=False,stateful=True,updated_at=2022-09-27T04:32:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:11.496137 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-181344'] for SecurityGroup (c7bcf143-e8dc-472e-9f7a-55fd2bac5488), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:11.496685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:11Z,description=,direction='ingress',ethertype='IPv4',id=1a8cef82-4e0d-4ca9-9e7b-445318217af5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='494bdfe04cfa4dfab2c7ab389a889298',protocol=,remote_address_group_id=,remote_group_id=c7bcf143-e8dc-472e-9f7a-55fd2bac5488,remote_ip_prefix=,revision_number=0,security_group_id=c7bcf143-e8dc-472e-9f7a-55fd2bac5488,updated_at=2022-09-27T04:32:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:11.497114 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (1a8cef82-4e0d-4ca9-9e7b-445318217af5), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:11.497557 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Security group rule updated ['c7bcf143-e8dc-472e-9f7a-55fd2bac5488'] Sep 27 04:32:11.498455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:11Z,description=,direction='ingress',ethertype='IPv6',id=2f42632f-cd3b-4cc8-95f9-d6239c34144b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='494bdfe04cfa4dfab2c7ab389a889298',protocol=,remote_address_group_id=,remote_group_id=c7bcf143-e8dc-472e-9f7a-55fd2bac5488,remote_ip_prefix=,revision_number=0,security_group_id=c7bcf143-e8dc-472e-9f7a-55fd2bac5488,updated_at=2022-09-27T04:32:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:11.498892 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (2f42632f-cd3b-4cc8-95f9-d6239c34144b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:11.499292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Security group rule updated ['c7bcf143-e8dc-472e-9f7a-55fd2bac5488'] Sep 27 04:32:11.500012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:11Z,description=,direction='egress',ethertype='IPv6',id=6fe60e26-8ebb-4089-b219-a30af097301e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='494bdfe04cfa4dfab2c7ab389a889298',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c7bcf143-e8dc-472e-9f7a-55fd2bac5488,updated_at=2022-09-27T04:32:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:11.500435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (6fe60e26-8ebb-4089-b219-a30af097301e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:11.500835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Security group rule updated ['c7bcf143-e8dc-472e-9f7a-55fd2bac5488'] Sep 27 04:32:11.501554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-27T04:32:11Z,description=,direction='egress',ethertype='IPv4',id=81c1a6c1-15a5-4873-95a9-d23a898e1bea,normalized_cidr=None,port_range_max=,port_range_min=,project_id='494bdfe04cfa4dfab2c7ab389a889298',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c7bcf143-e8dc-472e-9f7a-55fd2bac5488,updated_at=2022-09-27T04:32:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:11.501998 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-181317'] for SecurityGroupRule (81c1a6c1-15a5-4873-95a9-d23a898e1bea), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:11.502408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Security group rule updated ['c7bcf143-e8dc-472e-9f7a-55fd2bac5488'] Sep 27 04:32:11.645427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-27T04:32:11Z,description='',dns_domain=None,id=2d8e1010-a99b-4d47-a52c-48fef59dac1e,mtu=1500,name='tempest-VolumesActionsTest-1855669161-network',project_id='494bdfe04cfa4dfab2c7ab389a889298',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(2d8e1010-a99b-4d47-a52c-48fef59dac1e),segments=[NetworkSegment(0f04e42c-88a7-435b-b2eb-5415cc28c92b)],shared=False,status='ACTIVE',updated_at=2022-09-27T04:32:11Z,vlan_transparent=) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:11.645834 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (2d8e1010-a99b-4d47-a52c-48fef59dac1e), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager [None req-08ff229b-dfc1-49db-8d48-7656381b2613 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2d8e1010-a99b-4d47-a52c-48fef59dac1e with segmentation id not found. Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 27 04:32:11.720385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 27 04:32:11.721503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 27 04:32:11.721503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 27 04:32:11.721503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 27 04:32:11.721503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2d8e1010-a99b-4d47-a52c-48fef59dac1e with segmentation id not found. Sep 27 04:32:11.721503 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: ERROR neutron_lib.callbacks.manager Sep 27 04:32:11.887985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:604 started Sep 27 04:32:11.890984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=715000000,duration_sec=1221,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:11.891562 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:11.892125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:604 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:11.901568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e05faffd-052c-470f-8489-cad46ddd9852 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(1a68fe39-881b-4948-a780-cd60eb7066f5)],cidr=172.20.0.0/28,created_at=2022-09-27T04:32:11Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=c2307ff2-5d50-4a53-b597-7e61e4d9da32,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-1855669161-subnet',network_id=2d8e1010-a99b-4d47-a52c-48fef59dac1e,project_id='494bdfe04cfa4dfab2c7ab389a889298',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-27T04:32:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:11.901929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-e05faffd-052c-470f-8489-cad46ddd9852 admin admin] Publish callbacks [] for Subnet (c2307ff2-5d50-4a53-b597-7e61e4d9da32), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:12.792981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-d97cc207-5018-4efc-9f05-db8d40ec6c8f tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource Port deleted: 1712560b-01e8-4b96-8c66-8877d22eba22 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:12.793627 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-d97cc207-5018-4efc-9f05-db8d40ec6c8f tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (1712560b-01e8-4b96-8c66-8877d22eba22), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:12.794052 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-d97cc207-5018-4efc-9f05-db8d40ec6c8f tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group member updated {'dc8aeeb6-4f41-4b60-b98c-998d780399e1'} Sep 27 04:32:13.888597 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:605 started Sep 27 04:32:13.891251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f5d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=715000000,duration_sec=1223,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:13.891951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:13.892348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:605 - starting polling. Elapsed:0.004 Sep 27 04:32:13.894204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:13.895558 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 1712560b-01e8-4b96-8c66-8877d22eba22 not present in bridge br-int Sep 27 04:32:13.895894 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:32:13.896206 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['1712560b-01e8-4b96-8c66-8877d22eba22'] Sep 27 04:32:13.896527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 1712560b-01e8-4b96-8c66-8877d22eba22 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:32:13.898914 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:605 - port information retrieved. Elapsed:0.010 Sep 27 04:32:13.899247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:605 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:32:15.889518 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:606 started Sep 27 04:32:15.892245 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=716000000,duration_sec=1225,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:15.892818 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:15.893171 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:606 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:16.390325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7fa0cb42-5e8c-4253-9627-f67330cf5c2f tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:32:15Z,data_plane_status=None,description='',device_id='cb3757a7-2228-48e1-ad30-95f66c6b55f8',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0a8c54ff-8ed7-4f2c-9293-48d6c353b576,mac_address=fa:16:3e:97:bf:a0,name='',network_id=2d8e1010-a99b-4d47-a52c-48fef59dac1e,numa_affinity_policy=,project_id='494bdfe04cfa4dfab2c7ab389a889298',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0a8c54ff-8ed7-4f2c-9293-48d6c353b576),security_group_ids=set([c7bcf143-e8dc-472e-9f7a-55fd2bac5488]),status='DOWN',updated_at=2022-09-27T04:32:15Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:16.391416 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7fa0cb42-5e8c-4253-9627-f67330cf5c2f tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0a8c54ff-8ed7-4f2c-9293-48d6c353b576), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:16.392211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-7fa0cb42-5e8c-4253-9627-f67330cf5c2f tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Security group member updated {'c7bcf143-e8dc-472e-9f7a-55fd2bac5488'} Sep 27 04:32:17.297903 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c4638586-7530-4869-92fc-632c96a1adba service neutron] Resource Port 0a8c54ff-8ed7-4f2c-9293-48d6c353b576 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0a8c54ff-8ed7-4f2c-9293-48d6c353b576,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=0a8c54ff-8ed7-4f2c-9293-48d6c353b576,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:17.298532 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c4638586-7530-4869-92fc-632c96a1adba service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0a8c54ff-8ed7-4f2c-9293-48d6c353b576), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:17.446583 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2de39721-e90a-40a9-b9ff-3530156536f7 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:32:16Z,data_plane_status=None,description='',device_id='56108588-5052-4cbc-b248-29229aef7aec',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f9768712-2949-4085-b485-9a6386391423,mac_address=fa:16:3e:6b:8f:d9,name='',network_id=df4f6840-004b-4387-a687-683e2895186f,numa_affinity_policy=,project_id='53d86b6e8a8343fca03ca6d38200f23f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f9768712-2949-4085-b485-9a6386391423),security_group_ids=set([dc8aeeb6-4f41-4b60-b98c-998d780399e1]),status='DOWN',updated_at=2022-09-27T04:32:17Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:17.447938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2de39721-e90a-40a9-b9ff-3530156536f7 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f9768712-2949-4085-b485-9a6386391423), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:17.448398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2de39721-e90a-40a9-b9ff-3530156536f7 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group member updated {'dc8aeeb6-4f41-4b60-b98c-998d780399e1'} Sep 27 04:32:17.890895 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:607 started Sep 27 04:32:17.893375 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f61,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=718000000,duration_sec=1227,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:17.894071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:17.894591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:607 - starting polling. Elapsed:0.004 Sep 27 04:32:17.896425 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:17.898985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:607 - port information retrieved. Elapsed:0.008 Sep 27 04:32:17.899395 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:607 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:32:17.905577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c4638586-7530-4869-92fc-632c96a1adba service neutron] Resource Port 0a8c54ff-8ed7-4f2c-9293-48d6c353b576 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=0a8c54ff-8ed7-4f2c-9293-48d6c353b576,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=0a8c54ff-8ed7-4f2c-9293-48d6c353b576,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=0a8c54ff-8ed7-4f2c-9293-48d6c353b576,segment=NetworkSegment(0f04e42c-88a7-435b-b2eb-5415cc28c92b),segment_id=0f04e42c-88a7-435b-b2eb-5415cc28c92b)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:17.906063 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c4638586-7530-4869-92fc-632c96a1adba service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0a8c54ff-8ed7-4f2c-9293-48d6c353b576), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:18.377815 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-98857ce3-5182-4995-b8ad-b4aa7476d875 service neutron] Resource Port f9768712-2949-4085-b485-9a6386391423 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=f9768712-2949-4085-b485-9a6386391423,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=f9768712-2949-4085-b485-9a6386391423,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:18.378438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-98857ce3-5182-4995-b8ad-b4aa7476d875 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f9768712-2949-4085-b485-9a6386391423), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:18.711858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-98857ce3-5182-4995-b8ad-b4aa7476d875 service neutron] Resource Port f9768712-2949-4085-b485-9a6386391423 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=f9768712-2949-4085-b485-9a6386391423,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=f9768712-2949-4085-b485-9a6386391423,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=f9768712-2949-4085-b485-9a6386391423,segment=NetworkSegment(3855b0db-49a1-4957-864c-539480ffde2c),segment_id=3855b0db-49a1-4957-864c-539480ffde2c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:18.712246 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-98857ce3-5182-4995-b8ad-b4aa7476d875 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f9768712-2949-4085-b485-9a6386391423), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:19.892445 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:608 started Sep 27 04:32:19.895001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=719000000,duration_sec=1229,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:19.895614 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:19.895951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:608 - starting polling. Elapsed:0.004 Sep 27 04:32:19.897984 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:19.900183 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:608 - port information retrieved. Elapsed:0.008 Sep 27 04:32:19.900542 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:608 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:32:21.372202 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 0a8c54ff-8ed7-4f2c-9293-48d6c353b576 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:21.372837 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0a8c54ff-8ed7-4f2c-9293-48d6c353b576), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:21.893720 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:609 started Sep 27 04:32:21.896207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f65,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=720000000,duration_sec=1231,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:21.897276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:21.897657 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:609 - starting polling. Elapsed:0.004 Sep 27 04:32:21.899454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:21.901589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:609 - port information retrieved. Elapsed:0.008 Sep 27 04:32:21.901960 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:609 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:32:23.383871 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 0a8c54ff-8ed7-4f2c-9293-48d6c353b576 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:23.384521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (0a8c54ff-8ed7-4f2c-9293-48d6c353b576), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:23.894768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:610 started Sep 27 04:32:23.897665 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=721000000,duration_sec=1233,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:23.898372 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:23.898784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:610 - starting polling. Elapsed:0.004 Sep 27 04:32:23.900546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:23.903304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:610 - port information retrieved. Elapsed:0.009 Sep 27 04:32:23.903645 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:610 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:32:25.895800 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:611 started Sep 27 04:32:25.898907 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f69,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=723000000,duration_sec=1235,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:25.899504 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:25.899857 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:611 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:27.425041 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port f9768712-2949-4085-b485-9a6386391423 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:27.425631 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f9768712-2949-4085-b485-9a6386391423), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:27.897290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:612 started Sep 27 04:32:27.899761 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f6b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=724000000,duration_sec=1237,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:27.900354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:27.900685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:612 - starting polling. Elapsed:0.004 Sep 27 04:32:27.902534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:27.904701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:612 - port information retrieved. Elapsed:0.008 Sep 27 04:32:27.905060 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:612 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:32:28.707541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3c967303-35d0-4bca-b061-225bb8d38d50 tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Resource Port deleted: 0a8c54ff-8ed7-4f2c-9293-48d6c353b576 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:28.708944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3c967303-35d0-4bca-b061-225bb8d38d50 tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (0a8c54ff-8ed7-4f2c-9293-48d6c353b576), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:28.709544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-3c967303-35d0-4bca-b061-225bb8d38d50 tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Security group member updated {'c7bcf143-e8dc-472e-9f7a-55fd2bac5488'} Sep 27 04:32:29.452628 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port f9768712-2949-4085-b485-9a6386391423 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:29.452936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (f9768712-2949-4085-b485-9a6386391423), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:29.898437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:613 started Sep 27 04:32:29.900860 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f6d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=725000000,duration_sec=1239,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:29.901434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:29.901796 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:613 - starting polling. Elapsed:0.004 Sep 27 04:32:29.903547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:29.904713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 0a8c54ff-8ed7-4f2c-9293-48d6c353b576 not present in bridge br-int Sep 27 04:32:29.905051 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:32:29.905339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['0a8c54ff-8ed7-4f2c-9293-48d6c353b576'] Sep 27 04:32:29.905668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 0a8c54ff-8ed7-4f2c-9293-48d6c353b576 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:32:29.907798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:613 - port information retrieved. Elapsed:0.009 Sep 27 04:32:29.908137 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:613 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:32:31.899408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:614 started Sep 27 04:32:31.902606 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=726000000,duration_sec=1241,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:31.903188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:31.903560 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:614 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:32.118610 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-aa98b344-63f3-45a7-a20f-66b33b1bea26 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:32:31Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6090ef6a-f603-41ca-8147-d2963fee1c7b,mac_address=fa:16:3e:1a:b8:25,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6090ef6a-f603-41ca-8147-d2963fee1c7b),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:32:31Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:32.119241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-aa98b344-63f3-45a7-a20f-66b33b1bea26 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6090ef6a-f603-41ca-8147-d2963fee1c7b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:32.641449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c3ef365b-1fc5-4341-a8b4-597b84aa4437 tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:32:32Z,data_plane_status=None,description='',device_id='098cd137-f2d7-47ab-ae56-86245494f738',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=62eec92a-875e-4b18-93d9-31fe99c92ac4,mac_address=fa:16:3e:0e:d3:47,name='',network_id=2d8e1010-a99b-4d47-a52c-48fef59dac1e,numa_affinity_policy=,project_id='494bdfe04cfa4dfab2c7ab389a889298',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(62eec92a-875e-4b18-93d9-31fe99c92ac4),security_group_ids=set([c7bcf143-e8dc-472e-9f7a-55fd2bac5488]),status='DOWN',updated_at=2022-09-27T04:32:32Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:32:32.642273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c3ef365b-1fc5-4341-a8b4-597b84aa4437 tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (62eec92a-875e-4b18-93d9-31fe99c92ac4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:32.643001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-c3ef365b-1fc5-4341-a8b4-597b84aa4437 tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Security group member updated {'c7bcf143-e8dc-472e-9f7a-55fd2bac5488'} Sep 27 04:32:32.983690 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-aa98b344-63f3-45a7-a20f-66b33b1bea26 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource Port 6090ef6a-f603-41ca-8147-d2963fee1c7b updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '6f671b17-6c69-410c-9dd0-ffc9b324711c'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:32.984368 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-aa98b344-63f3-45a7-a20f-66b33b1bea26 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (6090ef6a-f603-41ca-8147-d2963fee1c7b), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:33.109602 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c95f8abc-a000-4a9b-8185-a2ffb77ad0be service neutron] Resource Port 62eec92a-875e-4b18-93d9-31fe99c92ac4 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=62eec92a-875e-4b18-93d9-31fe99c92ac4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=62eec92a-875e-4b18-93d9-31fe99c92ac4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:33.110075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c95f8abc-a000-4a9b-8185-a2ffb77ad0be service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (62eec92a-875e-4b18-93d9-31fe99c92ac4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:33.400011 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c95f8abc-a000-4a9b-8185-a2ffb77ad0be service neutron] Resource Port 62eec92a-875e-4b18-93d9-31fe99c92ac4 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=62eec92a-875e-4b18-93d9-31fe99c92ac4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=62eec92a-875e-4b18-93d9-31fe99c92ac4,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=62eec92a-875e-4b18-93d9-31fe99c92ac4,segment=NetworkSegment(0f04e42c-88a7-435b-b2eb-5415cc28c92b),segment_id=0f04e42c-88a7-435b-b2eb-5415cc28c92b)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:33.400523 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c95f8abc-a000-4a9b-8185-a2ffb77ad0be service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (62eec92a-875e-4b18-93d9-31fe99c92ac4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:33.900847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:615 started Sep 27 04:32:33.903382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f71,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=728000000,duration_sec=1243,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:33.904039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:33.904388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:615 - starting polling. Elapsed:0.004 Sep 27 04:32:33.906216 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:33.908541 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:615 - port information retrieved. Elapsed:0.008 Sep 27 04:32:33.908887 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:615 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:32:35.485719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 62eec92a-875e-4b18-93d9-31fe99c92ac4 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:35.486353 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (62eec92a-875e-4b18-93d9-31fe99c92ac4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:35.901378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:616 started Sep 27 04:32:35.903743 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f73,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=728000000,duration_sec=1245,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:35.904332 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:35.904721 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:616 - starting polling. Elapsed:0.004 Sep 27 04:32:35.906610 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:35.908740 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:616 - port information retrieved. Elapsed:0.008 Sep 27 04:32:35.909087 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:616 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:32:37.486289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 62eec92a-875e-4b18-93d9-31fe99c92ac4 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:32:37.486927 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (62eec92a-875e-4b18-93d9-31fe99c92ac4), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:37.902164 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:617 started Sep 27 04:32:37.904589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=729000000,duration_sec=1247,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:37.905173 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:37.905516 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:617 - starting polling. Elapsed:0.004 Sep 27 04:32:37.907341 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:37.909470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:617 - port information retrieved. Elapsed:0.007 Sep 27 04:32:37.909829 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:617 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:32:39.903185 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:618 started Sep 27 04:32:39.905489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=730000000,duration_sec=1249,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:39.906113 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:39.906644 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:618 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:41.904354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:619 started Sep 27 04:32:41.906858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=731000000,duration_sec=1251,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:41.907579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:41.908096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:619 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:41.921734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-18a26002-779a-4bb0-9410-43d7c3b43f8f tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Resource Port deleted: 62eec92a-875e-4b18-93d9-31fe99c92ac4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:32:41.922434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-18a26002-779a-4bb0-9410-43d7c3b43f8f tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (62eec92a-875e-4b18-93d9-31fe99c92ac4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:41.923196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-18a26002-779a-4bb0-9410-43d7c3b43f8f tempest-VolumesActionsTest-874250999 tempest-VolumesActionsTest-874250999-project] Security group member updated {'c7bcf143-e8dc-472e-9f7a-55fd2bac5488'} Sep 27 04:32:43.905817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:620 started Sep 27 04:32:43.908290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=732000000,duration_sec=1253,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:43.908869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:43.909210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:620 - starting polling. Elapsed:0.004 Sep 27 04:32:43.911269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:32:43.912476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 62eec92a-875e-4b18-93d9-31fe99c92ac4 not present in bridge br-int Sep 27 04:32:43.912812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:32:43.913098 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['62eec92a-875e-4b18-93d9-31fe99c92ac4'] Sep 27 04:32:43.913423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 62eec92a-875e-4b18-93d9-31fe99c92ac4 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:32:43.916048 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:620 - port information retrieved. Elapsed:0.010 Sep 27 04:32:43.916408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:620 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:32:45.907046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:621 started Sep 27 04:32:45.909447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f7d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=734000000,duration_sec=1255,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:45.910034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:45.910389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:621 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:47.907851 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:622 started Sep 27 04:32:47.910366 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f7f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=734000000,duration_sec=1257,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:47.910942 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:47.911428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:622 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:49.908795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:623 started Sep 27 04:32:49.912390 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f81,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=736000000,duration_sec=1259,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:49.914088 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:49.914500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:623 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:32:51.910178 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:624 started Sep 27 04:32:51.914537 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f83,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=738000000,duration_sec=1261,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:51.915343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:51.915934 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:624 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:32:53.911339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:625 started Sep 27 04:32:53.915587 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f85,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=739000000,duration_sec=1263,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:53.916454 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:53.917009 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:625 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 27 04:32:55.913155 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:626 started Sep 27 04:32:55.915378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f87,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=739000000,duration_sec=1265,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:55.915985 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:55.916354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:626 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:57.913686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:627 started Sep 27 04:32:57.916607 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f89,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=740000000,duration_sec=1267,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:57.917483 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:57.917881 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:627 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:32:59.914628 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:628 started Sep 27 04:32:59.917686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f8b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=741000000,duration_sec=1269,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:32:59.918493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:32:59.919156 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:628 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:33:01.916406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:629 started Sep 27 04:33:01.919001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f8d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=743000000,duration_sec=1271,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:01.919571 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:01.919921 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:629 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:03.917705 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:630 started Sep 27 04:33:03.920242 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f8f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=744000000,duration_sec=1273,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:03.920826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:03.921191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:630 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:04.260930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3793c1e3-dd02-42e2-9be1-ebb88c9de9ba admin admin] Resource Subnet deleted: c2307ff2-5d50-4a53-b597-7e61e4d9da32 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:33:04.261408 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3793c1e3-dd02-42e2-9be1-ebb88c9de9ba admin admin] Publish callbacks [] for Subnet (c2307ff2-5d50-4a53-b597-7e61e4d9da32), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:33:04.554961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7bb8cac4-cf66-4a32-a7da-8f1adf5f2026 admin admin] Resource Network deleted: 2d8e1010-a99b-4d47-a52c-48fef59dac1e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:33:04.555360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7bb8cac4-cf66-4a32-a7da-8f1adf5f2026 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (2d8e1010-a99b-4d47-a52c-48fef59dac1e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:33:04.815957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Resource SecurityGroup deleted: c7bcf143-e8dc-472e-9f7a-55fd2bac5488 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:33:04.816556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (c7bcf143-e8dc-472e-9f7a-55fd2bac5488), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:33:04.817028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c7bcf143-e8dc-472e-9f7a-55fd2bac5488',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:33:04.830304 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c7bcf143-e8dc-472e-9f7a-55fd2bac5488',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:33:04.831051 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Resource SecurityGroupRule deleted: 1a8cef82-4e0d-4ca9-9e7b-445318217af5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:33:04.831484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (1a8cef82-4e0d-4ca9-9e7b-445318217af5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:33:04.831888 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Security group rule updated ['c7bcf143-e8dc-472e-9f7a-55fd2bac5488'] Sep 27 04:33:04.832287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Resource SecurityGroupRule deleted: 2f42632f-cd3b-4cc8-95f9-d6239c34144b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:33:04.832635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2f42632f-cd3b-4cc8-95f9-d6239c34144b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:33:04.832994 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Security group rule updated ['c7bcf143-e8dc-472e-9f7a-55fd2bac5488'] Sep 27 04:33:04.833366 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Resource SecurityGroupRule deleted: 6fe60e26-8ebb-4089-b219-a30af097301e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:33:04.833707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6fe60e26-8ebb-4089-b219-a30af097301e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:33:04.834057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Security group rule updated ['c7bcf143-e8dc-472e-9f7a-55fd2bac5488'] Sep 27 04:33:04.834426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Resource SecurityGroupRule deleted: 81c1a6c1-15a5-4873-95a9-d23a898e1bea {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:33:04.834766 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (81c1a6c1-15a5-4873-95a9-d23a898e1bea), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:33:04.835090 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-f3460f6d-583e-4eb9-a437-b1d78633cc08 admin admin] Security group rule updated ['c7bcf143-e8dc-472e-9f7a-55fd2bac5488'] Sep 27 04:33:05.918584 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:631 started Sep 27 04:33:05.922226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f91,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=745000000,duration_sec=1275,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:05.922226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:05.922226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:631 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:07.920023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:632 started Sep 27 04:33:07.922447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f93,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=747000000,duration_sec=1277,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:07.923050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:07.923401 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:632 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:09.920559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:633 started Sep 27 04:33:09.923262 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f95,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=747000000,duration_sec=1279,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:09.923838 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:09.924191 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:633 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:11.921714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:634 started Sep 27 04:33:11.924094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f97,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=748000000,duration_sec=1281,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:11.924688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:11.925036 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:634 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:33:13.922432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:635 started Sep 27 04:33:13.924782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=749000000,duration_sec=1283,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:13.925352 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:13.925701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:635 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:33:15.923080 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:636 started Sep 27 04:33:15.925438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f9b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=750000000,duration_sec=1285,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:15.926596 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:15.926946 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:636 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:17.924447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:637 started Sep 27 04:33:17.927063 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f9d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=751000000,duration_sec=1287,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:17.927640 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:17.927995 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:637 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:19.926179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:638 started Sep 27 04:33:19.928826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22f9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=753000000,duration_sec=1289,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:19.929388 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:19.929761 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:638 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:21.927104 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:639 started Sep 27 04:33:21.929530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fa1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=754000000,duration_sec=1291,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:21.930386 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:21.930739 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:639 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:23.928176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:640 started Sep 27 04:33:23.930589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fa3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=755000000,duration_sec=1293,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:23.931157 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:23.931508 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:640 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:33:25.929545 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:641 started Sep 27 04:33:25.931911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fa5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=756000000,duration_sec=1295,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:25.932479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:25.932831 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:641 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:33:27.930757 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:642 started Sep 27 04:33:27.933135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fa7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=757000000,duration_sec=1297,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:27.933709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:27.934095 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:642 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:29.931253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:643 started Sep 27 04:33:29.933634 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fa9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=758000000,duration_sec=1299,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:29.934237 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:29.934594 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:643 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:33:31.932452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:644 started Sep 27 04:33:31.934900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=759000000,duration_sec=1301,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:31.935462 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:31.935811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:644 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:33.933374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:645 started Sep 27 04:33:33.935755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=760000000,duration_sec=1303,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:33.936318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:33.936669 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:645 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:33:35.934653 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:646 started Sep 27 04:33:35.937010 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22faf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=761000000,duration_sec=1305,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:35.937578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:35.937956 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:646 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:33:37.935616 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:647 started Sep 27 04:33:37.937973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fb1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=762000000,duration_sec=1307,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:37.938549 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:37.938901 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:647 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:33:39.936935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:648 started Sep 27 04:33:39.944471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fb3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=769000000,duration_sec=1309,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:39.945043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:39.945393 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:648 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:33:41.937801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:649 started Sep 27 04:33:41.940210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fb5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=764000000,duration_sec=1311,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:41.940775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:41.941129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:649 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:43.938882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:650 started Sep 27 04:33:43.941213 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fb7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=765000000,duration_sec=1313,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:43.941808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:43.942163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:650 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:33:45.939764 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:651 started Sep 27 04:33:45.942210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fb9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=766000000,duration_sec=1315,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:45.942785 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:45.943140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:651 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:47.940569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:652 started Sep 27 04:33:47.942976 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fbb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=767000000,duration_sec=1317,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:47.943645 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:47.944004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:652 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:49.941621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:653 started Sep 27 04:33:49.944020 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fbd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=768000000,duration_sec=1319,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:49.944626 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:49.944979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:653 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:51.942471 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:654 started Sep 27 04:33:51.944861 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fbf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=769000000,duration_sec=1321,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:51.945485 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:51.945900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:654 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:53.943683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:655 started Sep 27 04:33:53.946148 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fc1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=770000000,duration_sec=1323,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:53.946794 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:53.947127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:655 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:55.944807 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:656 started Sep 27 04:33:55.947292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fc3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=771000000,duration_sec=1325,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:55.947897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:55.948301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:656 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:33:57.945489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:657 started Sep 27 04:33:57.947862 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fc5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=772000000,duration_sec=1327,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:57.948431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:57.948789 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:657 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:33:59.946428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:658 started Sep 27 04:33:59.948784 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fc7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=773000000,duration_sec=1329,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:33:59.949351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:33:59.949730 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:658 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:34:01.947998 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:659 started Sep 27 04:34:01.950521 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fc9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=775000000,duration_sec=1331,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:01.951112 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:01.951468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:659 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:03.949084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:660 started Sep 27 04:34:03.952019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fcb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=776000000,duration_sec=1333,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:03.952593 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:03.952948 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:660 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:05.949874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:661 started Sep 27 04:34:05.952267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fcd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=776000000,duration_sec=1335,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:05.952836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:05.953184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:661 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:07.951049 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:662 started Sep 27 04:34:07.953416 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fcf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=778000000,duration_sec=1337,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:07.954014 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:07.954380 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:662 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:09.952045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:663 started Sep 27 04:34:09.955823 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fd1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=779000000,duration_sec=1339,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:09.956400 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:09.956773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:663 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:34:11.523599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-2f16e241-08f2-4886-b81a-5042cc7d66e0 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:34:11Z,data_plane_status=None,description='',device_id='a1cee166-21d9-416d-86ce-c46b3155c551',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9f31f6d4-7a24-48fa-b2fb-0449f62084ff,mac_address=fa:16:3e:97:e7:b9,name='',network_id=df4f6840-004b-4387-a687-683e2895186f,numa_affinity_policy=,project_id='53d86b6e8a8343fca03ca6d38200f23f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9f31f6d4-7a24-48fa-b2fb-0449f62084ff),security_group_ids=set([dc8aeeb6-4f41-4b60-b98c-998d780399e1]),status='DOWN',updated_at=2022-09-27T04:34:11Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:34:11.524318 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-2f16e241-08f2-4886-b81a-5042cc7d66e0 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9f31f6d4-7a24-48fa-b2fb-0449f62084ff), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:11.524511 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-2f16e241-08f2-4886-b81a-5042cc7d66e0 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group member updated {'dc8aeeb6-4f41-4b60-b98c-998d780399e1'} Sep 27 04:34:11.952475 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:664 started Sep 27 04:34:11.956275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fd3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=779000000,duration_sec=1341,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:11.957028 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:11.957423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:664 - starting polling. Elapsed:0.005 Sep 27 04:34:11.959481 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:11.961870 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:664 - port information retrieved. Elapsed:0.010 Sep 27 04:34:11.962446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:664 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:34:12.098416 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-67160ec4-1038-407c-b360-4ded0d76d446 service neutron] Resource Port 9f31f6d4-7a24-48fa-b2fb-0449f62084ff updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=9f31f6d4-7a24-48fa-b2fb-0449f62084ff,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=9f31f6d4-7a24-48fa-b2fb-0449f62084ff,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:34:12.098869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-67160ec4-1038-407c-b360-4ded0d76d446 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9f31f6d4-7a24-48fa-b2fb-0449f62084ff), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:12.398035 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-67160ec4-1038-407c-b360-4ded0d76d446 service neutron] Resource Port 9f31f6d4-7a24-48fa-b2fb-0449f62084ff updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=9f31f6d4-7a24-48fa-b2fb-0449f62084ff,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-85918',port_id=9f31f6d4-7a24-48fa-b2fb-0449f62084ff,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-85918',level=0,port_id=9f31f6d4-7a24-48fa-b2fb-0449f62084ff,segment=NetworkSegment(3855b0db-49a1-4957-864c-539480ffde2c),segment_id=3855b0db-49a1-4957-864c-539480ffde2c)]} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:34:12.398489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-67160ec4-1038-407c-b360-4ded0d76d446 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9f31f6d4-7a24-48fa-b2fb-0449f62084ff), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:13.953490 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:665 started Sep 27 04:34:13.956585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fd5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=781000000,duration_sec=1343,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:13.957158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:13.957496 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:665 - starting polling. Elapsed:0.004 Sep 27 04:34:13.959540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:13.961699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:665 - port information retrieved. Elapsed:0.008 Sep 27 04:34:13.962087 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:665 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:34:15.954204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:666 started Sep 27 04:34:15.956774 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fd7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=781000000,duration_sec=1345,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:15.957346 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:15.957701 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:666 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:17.954919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:667 started Sep 27 04:34:17.957881 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fd9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=782000000,duration_sec=1347,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:17.958455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:17.958811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:667 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:19.955995 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:668 started Sep 27 04:34:19.958379 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fdb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=783000000,duration_sec=1349,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:19.958949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:19.959308 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:668 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:34:21.956896 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:669 started Sep 27 04:34:21.959365 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fdd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=784000000,duration_sec=1351,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:21.959967 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:21.960315 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:669 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:22.013847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 9f31f6d4-7a24-48fa-b2fb-0449f62084ff updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:34:22.014234 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9f31f6d4-7a24-48fa-b2fb-0449f62084ff), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:23.900855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Resource Port 9f31f6d4-7a24-48fa-b2fb-0449f62084ff updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:34:23.900855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7f207093-da85-406b-9edf-d1d799c3aaa9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (9f31f6d4-7a24-48fa-b2fb-0449f62084ff), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:23.957992 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:670 started Sep 27 04:34:23.960539 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fdf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=785000000,duration_sec=1353,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:23.961129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:23.961476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:670 - starting polling. Elapsed:0.004 Sep 27 04:34:23.963447 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:23.966286 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:670 - port information retrieved. Elapsed:0.008 Sep 27 04:34:23.966650 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:670 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:34:25.959040 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:671 started Sep 27 04:34:25.961523 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fe1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=786000000,duration_sec=1355,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:25.962140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:25.962499 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:671 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:26.997981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a5cfd5a-b3b7-4875-a45e-933b8f33a7db tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-27T04:34:26Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e1a96418-47d6-4b93-84b4-d884260e497c,mac_address=fa:16:3e:fc:81:b5,name='',network_id=4c2326fb-b4db-42c7-9331-4377c9818745,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e1a96418-47d6-4b93-84b4-d884260e497c),security_group_ids=set([]),status='N/A',updated_at=2022-09-27T04:34:26Z) {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 27 04:34:26.998642 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a5cfd5a-b3b7-4875-a45e-933b8f33a7db tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (e1a96418-47d6-4b93-84b4-d884260e497c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:27.615283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0a5cfd5a-b3b7-4875-a45e-933b8f33a7db tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource Port e1a96418-47d6-4b93-84b4-d884260e497c updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '12953f7c-ea78-4de7-9b84-ae1e3e33e981'} {{(pid=107232) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 27 04:34:27.615777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0a5cfd5a-b3b7-4875-a45e-933b8f33a7db tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-181299'] for Port (e1a96418-47d6-4b93-84b4-d884260e497c), after_update {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:27.959597 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:672 started Sep 27 04:34:27.962383 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fe3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=786000000,duration_sec=1357,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:27.962966 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:27.963302 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:672 - starting polling. Elapsed:0.004 Sep 27 04:34:27.965094 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:34:27.967235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:672 - port information retrieved. Elapsed:0.008 Sep 27 04:34:27.967572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:672 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:34:29.960184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:673 started Sep 27 04:34:29.962622 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fe5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=787000000,duration_sec=1359,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:29.963196 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:29.963553 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:673 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:31.961647 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:674 started Sep 27 04:34:31.964096 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fe7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=788000000,duration_sec=1361,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:31.964670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:31.965030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:674 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:33.962925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:675 started Sep 27 04:34:33.965312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fe9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=790000000,duration_sec=1363,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:33.965911 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:33.966270 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:675 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:35.963646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:676 started Sep 27 04:34:35.966067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22feb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=790000000,duration_sec=1365,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:35.966635 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:35.966987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:676 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:37.964781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:677 started Sep 27 04:34:37.967187 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=791000000,duration_sec=1367,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:37.967755 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:37.968106 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:677 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:34:39.965826 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:678 started Sep 27 04:34:39.968316 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=792000000,duration_sec=1369,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:39.968918 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:39.969273 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:678 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:41.966307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:679 started Sep 27 04:34:41.968691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ff1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=793000000,duration_sec=1371,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:41.969286 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:41.969658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:679 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:34:43.967709 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:680 started Sep 27 04:34:43.970111 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ff3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=794000000,duration_sec=1373,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:43.970678 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:43.971030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:680 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:34:45.968544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:681 started Sep 27 04:34:45.971287 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ff5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=795000000,duration_sec=1375,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:45.971865 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:45.972269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:681 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:47.969971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:682 started Sep 27 04:34:47.972605 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ff7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=797000000,duration_sec=1377,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:47.973204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:47.973576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:682 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:49.971023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:683 started Sep 27 04:34:49.973360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ff9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=798000000,duration_sec=1379,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:49.974067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:49.974427 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:683 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:51.971909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:684 started Sep 27 04:34:51.974290 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ffb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=798000000,duration_sec=1381,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:51.974850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:51.975198 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:684 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:34:53.973018 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:685 started Sep 27 04:34:53.975526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22ffd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=800000000,duration_sec=1383,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:53.976126 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:53.976477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:685 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:55.974075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:686 started Sep 27 04:34:55.976673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc22fff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=801000000,duration_sec=1385,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:55.977271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:55.977668 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:686 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:57.975381 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:687 started Sep 27 04:34:57.978621 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23001,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=802000000,duration_sec=1387,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:57.979192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:57.979546 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:687 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:34:59.976833 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:688 started Sep 27 04:34:59.979558 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23003,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=803000000,duration_sec=1389,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:34:59.980135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:34:59.980493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:688 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:01.978329 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:689 started Sep 27 04:35:01.980729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23005,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=805000000,duration_sec=1391,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:01.981297 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:01.981651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:689 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:03.979460 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:690 started Sep 27 04:35:03.981834 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23007,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=806000000,duration_sec=1393,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:03.982402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:03.982757 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:690 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:35:05.981004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:691 started Sep 27 04:35:05.983370 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23009,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=808000000,duration_sec=1395,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:05.983949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:05.984309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:691 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:35:07.981823 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:692 started Sep 27 04:35:07.984208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2300b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=808000000,duration_sec=1397,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:07.984781 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:07.985137 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:692 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:09.982854 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:693 started Sep 27 04:35:09.985263 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2300d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=809000000,duration_sec=1399,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:09.985864 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:09.986225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:693 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:11.984253 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:694 started Sep 27 04:35:11.986731 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2300f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=811000000,duration_sec=1401,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:11.987310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:11.987666 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:694 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:13.985624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:695 started Sep 27 04:35:13.988485 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23011,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=813000000,duration_sec=1403,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:13.989220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:13.989556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:695 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:15.986935 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:696 started Sep 27 04:35:15.989328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23013,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=814000000,duration_sec=1405,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:15.989931 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:15.990288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:696 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:17.987695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:697 started Sep 27 04:35:17.990303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23015,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=814000000,duration_sec=1407,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:17.990893 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:17.991254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:697 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:19.989247 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:698 started Sep 27 04:35:19.991753 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23017,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=816000000,duration_sec=1409,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:19.992365 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:19.992726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:698 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:21.990563 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:699 started Sep 27 04:35:21.993003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23019,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=817000000,duration_sec=1411,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:21.993578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:21.993961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:699 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:23.991786 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:700 started Sep 27 04:35:23.994284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2301b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=818000000,duration_sec=1413,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:23.994891 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:23.995249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:700 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:25.992811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:701 started Sep 27 04:35:25.995211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2301d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=819000000,duration_sec=1415,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:25.995822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:25.996176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:701 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:27.994362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:702 started Sep 27 04:35:27.997192 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2301f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=821000000,duration_sec=1417,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:27.997928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:27.998362 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:702 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:29.995699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:703 started Sep 27 04:35:29.998494 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23021,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=823000000,duration_sec=1419,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:29.999077 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:29.999439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:703 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:31.996477 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:704 started Sep 27 04:35:31.999363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23023,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=823000000,duration_sec=1421,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:32.000055 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:32.000435 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:704 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:33.997581 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:705 started Sep 27 04:35:34.000328 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23025,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=824000000,duration_sec=1423,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:34.000937 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:34.001296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:705 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:35.998367 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:706 started Sep 27 04:35:36.001010 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23027,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=825000000,duration_sec=1425,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:36.001586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:36.002222 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:706 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:37.999455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:707 started Sep 27 04:35:38.002114 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23029,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=826000000,duration_sec=1427,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:38.002694 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:38.003050 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:707 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:40.000242 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:708 started Sep 27 04:35:40.003151 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2302b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=827000000,duration_sec=1429,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:40.003722 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:40.004075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:708 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:42.000610 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:709 started Sep 27 04:35:42.003291 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2302d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=827000000,duration_sec=1431,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:42.003866 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:42.004223 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:709 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:44.001768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:710 started Sep 27 04:35:44.004212 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2302f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=828000000,duration_sec=1433,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:44.004779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:44.005128 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:710 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:46.002775 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:711 started Sep 27 04:35:46.005142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23031,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=829000000,duration_sec=1435,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:46.005719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:46.006104 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:711 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:35:48.003492 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:712 started Sep 27 04:35:48.005944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23033,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=830000000,duration_sec=1437,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:48.006513 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:48.006869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:712 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:50.004526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:713 started Sep 27 04:35:50.006930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23035,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=831000000,duration_sec=1439,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:50.007502 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:50.007861 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:713 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:52.005824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:714 started Sep 27 04:35:52.008034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23037,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=832000000,duration_sec=1441,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:52.008603 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:52.008952 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:714 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:35:54.006995 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:715 started Sep 27 04:35:54.009766 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23039,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=834000000,duration_sec=1443,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:54.010929 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:54.011342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:715 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:56.008178 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:716 started Sep 27 04:35:56.010597 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2303b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=835000000,duration_sec=1445,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:56.011818 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:56.012172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:716 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:35:56.795623 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-3a0993e4-c966-4f76-a7d2-6c5141d2df58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource Port deleted: e1a96418-47d6-4b93-84b4-d884260e497c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:35:56.796007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-3a0993e4-c966-4f76-a7d2-6c5141d2df58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (e1a96418-47d6-4b93-84b4-d884260e497c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:35:58.009136 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:717 started Sep 27 04:35:58.011588 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2303d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=836000000,duration_sec=1447,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:35:58.012164 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:35:58.012507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:717 - starting polling. Elapsed:0.004 Sep 27 04:35:58.014343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:35:58.015509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port e1a96418-47d6-4b93-84b4-d884260e497c not present in bridge br-int Sep 27 04:35:58.015875 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:35:58.016159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['e1a96418-47d6-4b93-84b4-d884260e497c'] Sep 27 04:35:58.016691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port e1a96418-47d6-4b93-84b4-d884260e497c is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:35:58.018794 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:717 - port information retrieved. Elapsed:0.010 Sep 27 04:35:58.019132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:717 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:35:59.912254 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-66a3dcc5-d973-445d-9638-b659f8b02658 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource Port deleted: 9f31f6d4-7a24-48fa-b2fb-0449f62084ff {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:35:59.912808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-66a3dcc5-d973-445d-9638-b659f8b02658 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (9f31f6d4-7a24-48fa-b2fb-0449f62084ff), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:35:59.913034 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-66a3dcc5-d973-445d-9638-b659f8b02658 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group member updated {'dc8aeeb6-4f41-4b60-b98c-998d780399e1'} Sep 27 04:36:00.010160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:718 started Sep 27 04:36:00.013194 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2303f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=837000000,duration_sec=1449,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:00.013795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:00.014129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:718 - starting polling. Elapsed:0.004 Sep 27 04:36:00.015897 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:00.017059 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 9f31f6d4-7a24-48fa-b2fb-0449f62084ff not present in bridge br-int Sep 27 04:36:00.017387 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:36:00.017671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['9f31f6d4-7a24-48fa-b2fb-0449f62084ff'] Sep 27 04:36:00.018016 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 9f31f6d4-7a24-48fa-b2fb-0449f62084ff is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:36:00.020135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:718 - port information retrieved. Elapsed:0.010 Sep 27 04:36:00.020467 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:718 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 27 04:36:02.011211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:719 started Sep 27 04:36:02.013549 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23041,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=838000000,duration_sec=1451,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:02.014174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:02.014526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:719 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:03.995334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-a9712711-59af-4b20-a92e-95a4a7f026c9 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource Port deleted: 6090ef6a-f603-41ca-8147-d2963fee1c7b {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:03.995925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-a9712711-59af-4b20-a92e-95a4a7f026c9 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (6090ef6a-f603-41ca-8147-d2963fee1c7b), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:04.011636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:720 started Sep 27 04:36:04.014671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23043,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=839000000,duration_sec=1453,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:04.015443 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:04.015864 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:720 - starting polling. Elapsed:0.004 Sep 27 04:36:04.017835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:04.019506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 6090ef6a-f603-41ca-8147-d2963fee1c7b not present in bridge br-int Sep 27 04:36:04.019926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:36:04.020303 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['6090ef6a-f603-41ca-8147-d2963fee1c7b'] Sep 27 04:36:04.020727 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 6090ef6a-f603-41ca-8147-d2963fee1c7b is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:36:04.022987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:720 - port information retrieved. Elapsed:0.011 Sep 27 04:36:04.023339 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:720 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:36:06.012879 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:721 started Sep 27 04:36:06.019267 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23045,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=840000000,duration_sec=1455,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:06.019933 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:06.020381 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:721 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:36:06.651626 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-0f955e75-4487-4320-accf-d5f4418f3ced tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource Port deleted: f9768712-2949-4085-b485-9a6386391423 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:06.652011 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0f955e75-4487-4320-accf-d5f4418f3ced tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (f9768712-2949-4085-b485-9a6386391423), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:06.652423 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0f955e75-4487-4320-accf-d5f4418f3ced tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group member updated {'dc8aeeb6-4f41-4b60-b98c-998d780399e1'} Sep 27 04:36:08.014522 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:722 started Sep 27 04:36:08.016835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23047,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=841000000,duration_sec=1457,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:08.017402 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:08.017757 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:722 - starting polling. Elapsed:0.003 Sep 27 04:36:08.019522 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:08.020678 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port f9768712-2949-4085-b485-9a6386391423 not present in bridge br-int Sep 27 04:36:08.021010 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:36:08.021292 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['f9768712-2949-4085-b485-9a6386391423'] Sep 27 04:36:08.021630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port f9768712-2949-4085-b485-9a6386391423 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:36:08.023714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:722 - port information retrieved. Elapsed:0.009 Sep 27 04:36:08.024046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:722 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:36:08.504129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-9689b260-a0cc-472e-a61a-b3b588abab99 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource Port deleted: 82514c3e-b0d5-48a2-aba5-a1b91df98ce5 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:08.504642 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-9689b260-a0cc-472e-a61a-b3b588abab99 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (82514c3e-b0d5-48a2-aba5-a1b91df98ce5), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:09.932429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource SecurityGroup deleted: dc8aeeb6-4f41-4b60-b98c-998d780399e1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:09.933535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (dc8aeeb6-4f41-4b60-b98c-998d780399e1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:09.934122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dc8aeeb6-4f41-4b60-b98c-998d780399e1',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:36:09.947416 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dc8aeeb6-4f41-4b60-b98c-998d780399e1',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:36:09.951310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource SecurityGroupRule deleted: 333df58e-cbee-4278-b1e8-b254b7172aa7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:09.951710 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (333df58e-cbee-4278-b1e8-b254b7172aa7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:09.952574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:36:09.952574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource SecurityGroupRule deleted: 77db1260-c534-4ab7-8a3b-120d03485bb7 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:09.952928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (77db1260-c534-4ab7-8a3b-120d03485bb7), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:09.953288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:36:09.953706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource SecurityGroupRule deleted: f51ffdda-15a6-4dcd-8145-fc7158f6ba19 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:09.954086 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (f51ffdda-15a6-4dcd-8145-fc7158f6ba19), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:09.954557 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:36:09.954943 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource SecurityGroupRule deleted: b10426d5-0aab-4f92-a0e8-94801206a991 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:09.955312 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b10426d5-0aab-4f92-a0e8-94801206a991), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:09.955679 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:36:09.956052 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource SecurityGroupRule deleted: 432716f0-3eab-493d-8f66-aa25d29eccc8 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:09.956392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (432716f0-3eab-493d-8f66-aa25d29eccc8), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:09.956714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:36:09.957084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource SecurityGroupRule deleted: bd059e0c-506d-4534-93ea-0d369f925e1f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:09.957426 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (bd059e0c-506d-4534-93ea-0d369f925e1f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:09.957804 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:36:09.958175 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource SecurityGroupRule deleted: 696bc1a5-554a-43e0-b016-630a1b6c4101 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:09.958638 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (696bc1a5-554a-43e0-b016-630a1b6c4101), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:09.958957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:36:09.959327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Resource SecurityGroupRule deleted: b6041ffc-164f-4bef-9176-52f875aa42cc {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:09.959663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b6041ffc-164f-4bef-9176-52f875aa42cc), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:09.959976 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-58132356-e63a-4758-b970-d9cd598b9b58 tempest-TestVolumeBootPattern-57324624 tempest-TestVolumeBootPattern-57324624-project] Security group rule updated ['dc8aeeb6-4f41-4b60-b98c-998d780399e1'] Sep 27 04:36:10.015529 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:723 started Sep 27 04:36:10.018204 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23049,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=842000000,duration_sec=1459,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:10.018785 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:10.019129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:723 - starting polling. Elapsed:0.004 Sep 27 04:36:10.021659 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:10.022871 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 82514c3e-b0d5-48a2-aba5-a1b91df98ce5 not present in bridge br-int Sep 27 04:36:10.023208 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:36:10.023501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['82514c3e-b0d5-48a2-aba5-a1b91df98ce5'] Sep 27 04:36:10.024063 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 82514c3e-b0d5-48a2-aba5-a1b91df98ce5 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:36:10.027369 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:723 - port information retrieved. Elapsed:0.012 Sep 27 04:36:10.027710 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:723 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 27 04:36:10.904268 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-c2868b46-dd59-408d-9d91-c79440602e83 admin admin] Resource Port deleted: 393bbc50-ff65-4a57-99fb-482a15b5ad7c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:10.904655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-c2868b46-dd59-408d-9d91-c79440602e83 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (393bbc50-ff65-4a57-99fb-482a15b5ad7c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:12.016002 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:724 started Sep 27 04:36:12.019392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2304b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=843000000,duration_sec=1461,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:12.020188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:12.020530 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:724 - starting polling. Elapsed:0.005 Sep 27 04:36:12.022321 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:12.025075 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-393bbc50-ff, col_values=(('tag', 4095),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:36:12.033902 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc2304d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:12.034301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['393bbc50-ff65-4a57-99fb-482a15b5ad7c'] Sep 27 04:36:12.034744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:36:12.040144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a53cd177-2dd9-4db1-8cad-88f285e8f78c","delete","qr-393bbc50-ff",35,["map",[["attached-mac","fa:16:3e:df:6f:f3"],["iface-id","393bbc50-ff65-4a57-99fb-482a15b5ad7c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:36:12.164058 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-533a7aa2-d931-4674-94d5-372b85304fb3 admin admin] Resource Port deleted: c96e44c5-6d17-4f3a-98f8-e69df467cdc3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:12.164437 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-533a7aa2-d931-4674-94d5-372b85304fb3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (c96e44c5-6d17-4f3a-98f8-e69df467cdc3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:12.403608 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[333d8cb8-6f94-4047-8623-0b6d2d2ca2c0]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:36:12.409027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc2304f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:12.409590 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:724 - port information retrieved. Elapsed:0.394 Sep 27 04:36:12.409987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:724 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.394 Sep 27 04:36:12.617964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-dc9694e0-11d5-4ab8-bceb-77fb4859c1b2 admin admin] Resource Subnet deleted: adae9526-5b78-4ae5-a4c5-ed40836bb98e {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:12.618527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-dc9694e0-11d5-4ab8-bceb-77fb4859c1b2 admin admin] Publish callbacks [] for Subnet (adae9526-5b78-4ae5-a4c5-ed40836bb98e), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:12.720043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["94550136-c4b8-4877-b0c2-3f100c9585de","delete","qg-c96e44c5-6d",34,["map",[["attached-mac","fa:16:3e:ee:37:94"],["iface-id","c96e44c5-6d17-4f3a-98f8-e69df467cdc3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:36:12.759228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4e9d1627-0d50-4379-a59d-607f0410d9f8","delete","tapab3d6ea0-06",33,["map",[["attached-mac","fa:16:3e:4f:87:4f"],["iface-id","ab3d6ea0-0620-4743-82ab-fc092700f894"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:36:12.936269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-09879177-03ad-4194-81b6-91570abc1eb2 admin admin] Resource Port deleted: ab3d6ea0-0620-4743-82ab-fc092700f894 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:12.936653 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-09879177-03ad-4194-81b6-91570abc1eb2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (ab3d6ea0-0620-4743-82ab-fc092700f894), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:13.178536 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-09879177-03ad-4194-81b6-91570abc1eb2 admin admin] Resource Network deleted: df4f6840-004b-4387-a687-683e2895186f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:13.179141 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-09879177-03ad-4194-81b6-91570abc1eb2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (df4f6840-004b-4387-a687-683e2895186f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:14.004611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-7cb99915-d4b7-4fa8-8244-14e063e1ce7a admin admin] Resource Port deleted: 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:14.005054 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-7cb99915-d4b7-4fa8-8244-14e063e1ce7a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (6e8b23b0-bc61-4571-9a21-75bb81bcfa43), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:14.017305 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:725 started Sep 27 04:36:14.020241 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23051,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=844000000,duration_sec=1463,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:14.022310 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:14.022878 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:725 - starting polling. Elapsed:0.006 Sep 27 04:36:14.024528 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:14.028158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6e8b23b0-bc, col_values=(('tag', 4095),)) {{(pid=107232) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 27 04:36:14.036381 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc23053,OFPFlowMod(buffer_id=4294967295,command=0,cookie=11020370386559921740,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:14.036778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for ['6e8b23b0-bc61-4571-9a21-75bb81bcfa43'] Sep 27 04:36:14.037439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 4 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:36:14.077085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6cb79b-242b-4ec4-b76b-0267fb635e5e]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:36:14.082089 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc23055,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:14.084076 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc23057,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:14.084609 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:725 - port information retrieved. Elapsed:0.067 Sep 27 04:36:14.085006 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'6e8b23b0-bc61-4571-9a21-75bb81bcfa43', 'f4c870bd-9fa2-4569-9b20-42c3918b2981', '25a54548-54d9-441f-b9e5-01972934299d', '6ee36b09-9938-4ec7-97df-f1b955bddb94', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': {'393bbc50-ff65-4a57-99fb-482a15b5ad7c', 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:36:14.085439 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:725 - agent port security group processed in 0.000 Sep 27 04:36:14.086779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:36:14.087151 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'393bbc50-ff65-4a57-99fb-482a15b5ad7c', 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3'} Sep 27 04:36:14.087540 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 393bbc50-ff65-4a57-99fb-482a15b5ad7c is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:36:14.089163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 8 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:36:14.147928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c24ef37-792d-4017-8fe2-a90c10a9cb86]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:36:14.148512 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'393bbc50-ff65-4a57-99fb-482a15b5ad7c', 'ab3d6ea0-0620-4743-82ab-fc092700f894', 'c96e44c5-6d17-4f3a-98f8-e69df467cdc3'} removed Sep 27 04:36:14.226000 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:36:14.226651 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:36:14.227101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 13 from net-id = df4f6840-004b-4387-a687-683e2895186f, seg-id = 100 Sep 27 04:36:14.231646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32ec9,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:14.233585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc23059,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4196}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:14.234017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:725 - treat_devices_removed completed in 0.147 Sep 27 04:36:14.234322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:725 - ports processed. Elapsed:0.217 Sep 27 04:36:14.234675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:725 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.218 Sep 27 04:36:15.006548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8590a171-9a13-486b-98ec-76232ace5a67","delete","qr-6e8b23b0-bc",37,["map",[["attached-mac","fa:16:3e:7e:d3:6e"],["iface-id","6e8b23b0-bc61-4571-9a21-75bb81bcfa43"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:36:15.022281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-1a1c09d3-1fcf-45bd-83a1-c6142a19e8bf admin admin] Resource Port deleted: 25a54548-54d9-441f-b9e5-01972934299d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:15.022603 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-1a1c09d3-1fcf-45bd-83a1-c6142a19e8bf admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (25a54548-54d9-441f-b9e5-01972934299d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:15.398507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["95bc50b1-bdd6-46f8-8af5-212afb73bc70","delete","qg-25a54548-54",38,["map",[["attached-mac","fa:16:3e:3a:dc:39"],["iface-id","25a54548-54d9-441f-b9e5-01972934299d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:36:15.470574 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-206bb7fb-f3fa-494f-bd40-0ec7d107e9f5 admin admin] Resource Subnet deleted: aac67899-dc5a-496e-bf8d-d7385b65acc1 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:15.471205 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-206bb7fb-f3fa-494f-bd40-0ec7d107e9f5 admin admin] Publish callbacks [] for Subnet (aac67899-dc5a-496e-bf8d-d7385b65acc1), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:15.726873 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e752eae0-5adc-4bf6-915f-20413121faf5","delete","tap6ee36b09-99",36,["map",[["attached-mac","fa:16:3e:07:16:4f"],["iface-id","6ee36b09-9938-4ec7-97df-f1b955bddb94"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107232) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 27 04:36:15.800977 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-821c12db-5e54-4979-afe8-0e47548cbf8c admin admin] Resource Port deleted: 6ee36b09-9938-4ec7-97df-f1b955bddb94 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:15.802301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-821c12db-5e54-4979-afe8-0e47548cbf8c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-181308'] for Port (6ee36b09-9938-4ec7-97df-f1b955bddb94), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:15.934630 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e4c9488c-2b06-4669-8abc-3080845d330c None None] Resource Port deleted: 6ee36b09-9938-4ec7-97df-f1b955bddb94 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:15.934981 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-e4c9488c-2b06-4669-8abc-3080845d330c None None] Skipped duplicate delete event for 6ee36b09-9938-4ec7-97df-f1b955bddb94 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 27 04:36:16.019468 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:726 started Sep 27 04:36:16.022769 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2305b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=846000000,duration_sec=1465,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:16.024343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:16.024894 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:726 - starting polling. Elapsed:0.006 Sep 27 04:36:16.028217 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-156152'] for ovsdb (None), after_read {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.032297 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc2305d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:16.034007 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc2305f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:16.036524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xbc23061,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:16.036840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:726 - port information retrieved. Elapsed:0.018 Sep 27 04:36:16.037228 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Starting to process devices in:{'current': {'f4c870bd-9fa2-4569-9b20-42c3918b2981', 'a9d279c0-f93b-406b-9d35-10eff3cffc78', '6dd4abab-9e71-4ddb-83f5-ae3de8e6eeb9', '91be2386-c6f4-4e65-920b-2ddb6d3c06b5'}, 'added': set(), 'removed': {'25a54548-54d9-441f-b9e5-01972934299d', '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', '6ee36b09-9938-4ec7-97df-f1b955bddb94'}, 'updated': set(), 're_added': set()} {{(pid=107232) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 27 04:36:16.037484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:726 - agent port security group processed in 0.000 Sep 27 04:36:16.038511 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Configuration for devices up [] and devices down [] completed. Sep 27 04:36:16.038869 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Remove device filter for {'25a54548-54d9-441f-b9e5-01972934299d', '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', '6ee36b09-9938-4ec7-97df-f1b955bddb94'} Sep 27 04:36:16.039261 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port 6e8b23b0-bc61-4571-9a21-75bb81bcfa43 is not handled by the firewall. {{(pid=107232) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 27 04:36:16.039679 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.common.ovs_lib [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Processing 8 OpenFlow rules. {{(pid=107232) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 27 04:36:16.053102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-821c12db-5e54-4979-afe8-0e47548cbf8c admin admin] Resource Network deleted: ff8958a9-1d15-4a33-98bb-91961388fca3 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.053489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-821c12db-5e54-4979-afe8-0e47548cbf8c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-223732'] for Network (ff8958a9-1d15-4a33-98bb-91961388fca3), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.090301 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG oslo.privsep.daemon [-] privsep: reply[17312a54-5b63-4c8b-b619-e5f955152047]: (4, ('', '', 0)) {{(pid=108929) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 27 04:36:16.090825 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Ports {'25a54548-54d9-441f-b9e5-01972934299d', '6e8b23b0-bc61-4571-9a21-75bb81bcfa43', '6ee36b09-9938-4ec7-97df-f1b955bddb94'} removed Sep 27 04:36:16.161733 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Port removal failed for set() {{(pid=107232) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 27 04:36:16.162464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] net_uuid None not managed by VLAN manager Sep 27 04:36:16.162841 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Reclaiming vlan = 14 from net-id = ff8958a9-1d15-4a33-98bb-91961388fca3, seg-id = 114 Sep 27 04:36:16.165579 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x6ec32ecb,OFPFlowMod(buffer_id=4294967295,command=3,cookie=8472736809372409585,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:16.168957 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xbc23063,OFPFlowMod(buffer_id=4294967295,command=3,cookie=11020370386559921740,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4210}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:16.169284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] process_network_ports - iteration:726 - treat_devices_removed completed in 0.130 Sep 27 04:36:16.169578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:726 - ports processed. Elapsed:0.151 Sep 27 04:36:16.169939 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:726 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.151 Sep 27 04:36:16.331839 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Resource SecurityGroup deleted: 070b0cf7-b41b-479d-a997-2fb12fe1fdad {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.332220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (070b0cf7-b41b-479d-a997-2fb12fe1fdad), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.332693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('070b0cf7-b41b-479d-a997-2fb12fe1fdad',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:36:16.346615 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('070b0cf7-b41b-479d-a997-2fb12fe1fdad',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:36:16.346953 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Resource SecurityGroupRule deleted: 375a5786-4fe8-4a93-b886-b72ab07aae3d {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.347322 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (375a5786-4fe8-4a93-b886-b72ab07aae3d), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.347675 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Security group rule updated ['070b0cf7-b41b-479d-a997-2fb12fe1fdad'] Sep 27 04:36:16.348256 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Resource SecurityGroupRule deleted: 6f5f2d57-e127-43b9-88e8-f7dee7fdd246 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.348743 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (6f5f2d57-e127-43b9-88e8-f7dee7fdd246), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.349071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Security group rule updated ['070b0cf7-b41b-479d-a997-2fb12fe1fdad'] Sep 27 04:36:16.349446 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Resource SecurityGroupRule deleted: 9f42c337-b3a9-4f49-97d4-e3839e3d14ba {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.349807 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (9f42c337-b3a9-4f49-97d4-e3839e3d14ba), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.350325 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Security group rule updated ['070b0cf7-b41b-479d-a997-2fb12fe1fdad'] Sep 27 04:36:16.350699 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Resource SecurityGroupRule deleted: c1a309cf-db0a-4db6-a4c2-391d7b103bbb {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.351045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (c1a309cf-db0a-4db6-a4c2-391d7b103bbb), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.351367 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-627db15a-f4b6-4531-8c58-5f622051a5fb admin admin] Security group rule updated ['070b0cf7-b41b-479d-a997-2fb12fe1fdad'] Sep 27 04:36:16.809127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Resource SecurityGroup deleted: 20bb106a-15a7-46e5-a255-a2be5cc14a4f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.809863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-181335'] for SecurityGroup (20bb106a-15a7-46e5-a255-a2be5cc14a4f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.809980 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('20bb106a-15a7-46e5-a255-a2be5cc14a4f',)}} {{(pid=107232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 27 04:36:16.823079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('20bb106a-15a7-46e5-a255-a2be5cc14a4f',)))} {{(pid=107232) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 27 04:36:16.823476 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Resource SecurityGroupRule deleted: 2f4ceb1b-a11d-4f36-9147-da70e9c0a08f {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.823841 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (2f4ceb1b-a11d-4f36-9147-da70e9c0a08f), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.824177 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Security group rule updated ['20bb106a-15a7-46e5-a255-a2be5cc14a4f'] Sep 27 04:36:16.824568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Resource SecurityGroupRule deleted: 51a67d50-8ef1-4b31-b902-537b4a7481a4 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.824912 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (51a67d50-8ef1-4b31-b902-537b4a7481a4), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.825385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Security group rule updated ['20bb106a-15a7-46e5-a255-a2be5cc14a4f'] Sep 27 04:36:16.825778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Resource SecurityGroupRule deleted: ad28742f-8c0f-4b8c-ac55-29426b566d0c {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.826214 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (ad28742f-8c0f-4b8c-ac55-29426b566d0c), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.826571 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Security group rule updated ['20bb106a-15a7-46e5-a255-a2be5cc14a4f'] Sep 27 04:36:16.826941 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.resource_cache [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Resource SecurityGroupRule deleted: b8ecb1fc-2012-4004-b3d0-15e18d7d2f47 {{(pid=107232) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 27 04:36:16.827281 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron_lib.callbacks.manager [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-181326'] for SecurityGroupRule (b8ecb1fc-2012-4004-b3d0-15e18d7d2f47), after_delete {{(pid=107232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 27 04:36:16.827598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.agent.securitygroups_rpc [None req-949fd4a1-c43d-4d46-868f-31d0be4687ba admin admin] Security group rule updated ['20bb106a-15a7-46e5-a255-a2be5cc14a4f'] Sep 27 04:36:18.019687 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:727 started Sep 27 04:36:18.022163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23065,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=846000000,duration_sec=1467,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:18.022760 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:18.023116 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:727 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:20.020914 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:728 started Sep 27 04:36:20.023559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23067,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=848000000,duration_sec=1469,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:20.024135 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:20.024507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:728 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:22.021763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:729 started Sep 27 04:36:22.024200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23069,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=848000000,duration_sec=1471,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:22.025264 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:22.025613 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:729 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:24.023085 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:730 started Sep 27 04:36:24.026165 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2306b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=850000000,duration_sec=1473,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:24.026704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:24.027057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:730 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:26.024698 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:731 started Sep 27 04:36:26.027160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2306d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=851000000,duration_sec=1475,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:26.027732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:26.028081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:731 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:28.024880 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:732 started Sep 27 04:36:28.027434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2306f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=851000000,duration_sec=1477,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:28.028039 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:28.028398 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:732 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:30.026078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:733 started Sep 27 04:36:30.028406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23071,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=853000000,duration_sec=1479,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:30.028973 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:30.029320 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:733 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:36:32.027224 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:734 started Sep 27 04:36:32.029549 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23073,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=854000000,duration_sec=1481,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:32.030145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:32.030498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:734 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:36:34.028012 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:735 started Sep 27 04:36:34.030381 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23075,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=855000000,duration_sec=1483,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:34.030949 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:34.031300 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:735 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:36:36.029419 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:736 started Sep 27 04:36:36.031782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23077,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=856000000,duration_sec=1485,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:36.032374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:36.032752 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:736 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:36:38.030825 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:737 started Sep 27 04:36:38.033207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23079,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=857000000,duration_sec=1487,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:38.033817 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:38.034174 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:737 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:40.031648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:738 started Sep 27 04:36:40.034037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2307b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=858000000,duration_sec=1489,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:40.034614 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:40.034990 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:738 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:42.032317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:739 started Sep 27 04:36:42.035024 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2307d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=859000000,duration_sec=1491,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:42.035591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:42.035990 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:739 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:44.033360 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:740 started Sep 27 04:36:44.036001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2307f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=860000000,duration_sec=1493,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:44.036568 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:44.036919 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:740 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:46.034566 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:741 started Sep 27 04:36:46.037163 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23081,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=861000000,duration_sec=1495,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:46.037736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:46.038119 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:741 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:48.035706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:742 started Sep 27 04:36:48.038748 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23083,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=862000000,duration_sec=1497,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:48.039353 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:48.039708 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:742 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:50.036735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:743 started Sep 27 04:36:50.039167 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23085,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=863000000,duration_sec=1499,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:50.039802 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:50.040547 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:743 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:52.038249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:744 started Sep 27 04:36:52.040649 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23087,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=865000000,duration_sec=1501,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:52.041212 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:52.041558 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:744 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:54.039462 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:745 started Sep 27 04:36:54.046535 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23089,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=866000000,duration_sec=1503,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:54.047133 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:54.047504 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:745 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:36:56.040679 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:746 started Sep 27 04:36:56.043952 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2308b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=868000000,duration_sec=1505,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:56.044524 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:56.044877 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:746 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:36:58.042882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:747 started Sep 27 04:36:58.046169 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2308d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=870000000,duration_sec=1507,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:36:58.046742 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:36:58.047100 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:747 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:37:00.043347 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:748 started Sep 27 04:37:00.045863 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2308f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=870000000,duration_sec=1509,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:00.046864 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:00.047219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:748 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:02.044432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:749 started Sep 27 04:37:02.046820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23091,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=871000000,duration_sec=1511,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:02.047392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:02.047746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:749 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:37:04.045747 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:750 started Sep 27 04:37:04.048113 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23093,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=872000000,duration_sec=1513,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:04.048711 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:04.049062 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:750 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:37:06.046671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:751 started Sep 27 04:37:06.049148 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23095,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=873000000,duration_sec=1515,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:06.049726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:06.050116 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:751 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:08.047209 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:752 started Sep 27 04:37:08.049667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23097,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=874000000,duration_sec=1517,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:08.050276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:08.050629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:752 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:10.047909 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:753 started Sep 27 04:37:10.050309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23099,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=874000000,duration_sec=1519,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:10.050882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:10.051236 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:753 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:12.048874 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:754 started Sep 27 04:37:12.051256 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2309b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=875000000,duration_sec=1521,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:12.051821 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:12.052166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:754 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:37:14.050252 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:755 started Sep 27 04:37:14.052641 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2309d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=877000000,duration_sec=1523,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:14.053221 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:14.053576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:755 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:37:16.051390 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:756 started Sep 27 04:37:16.053830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2309f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=878000000,duration_sec=1525,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:16.054409 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:16.054759 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:756 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:18.052599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:757 started Sep 27 04:37:18.055008 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=879000000,duration_sec=1527,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:18.055599 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:18.055971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:757 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:20.053430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:758 started Sep 27 04:37:20.055951 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=880000000,duration_sec=1529,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:20.056944 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:20.057478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:758 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:22.054736 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:759 started Sep 27 04:37:22.057559 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=881000000,duration_sec=1531,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:22.058278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:22.058729 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:759 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:24.056835 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:760 started Sep 27 04:37:24.059636 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=884000000,duration_sec=1533,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:24.060319 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:24.060744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:760 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:37:26.058184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:761 started Sep 27 04:37:26.061003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=885000000,duration_sec=1535,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:26.061578 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:26.061969 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:761 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:37:28.058180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:762 started Sep 27 04:37:28.064705 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=885000000,duration_sec=1537,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:28.065311 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:28.065670 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:762 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:37:30.058872 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:763 started Sep 27 04:37:30.062237 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=886000000,duration_sec=1539,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:30.062822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:30.063180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:763 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:32.059349 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:764 started Sep 27 04:37:32.061816 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=886000000,duration_sec=1541,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:32.062389 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:32.062744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:764 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:34.060666 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:765 started Sep 27 04:37:34.063773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=887000000,duration_sec=1543,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:34.064346 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:34.064702 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:765 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:36.061201 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:766 started Sep 27 04:37:36.063564 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=888000000,duration_sec=1545,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:36.064132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:36.064487 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:766 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:37:38.062656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:767 started Sep 27 04:37:38.065091 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=889000000,duration_sec=1547,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:38.065691 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:38.066067 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:767 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:40.063808 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:768 started Sep 27 04:37:40.066210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=890000000,duration_sec=1549,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:40.066779 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:40.067134 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:768 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:42.064747 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:769 started Sep 27 04:37:42.067509 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=891000000,duration_sec=1551,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:42.068078 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:42.068449 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:769 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:44.065534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:770 started Sep 27 04:37:44.068633 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=893000000,duration_sec=1553,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:44.069200 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:44.069548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:770 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:46.066624 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:771 started Sep 27 04:37:46.069505 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=894000000,duration_sec=1555,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:46.070103 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:46.070455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:771 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:48.067558 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:772 started Sep 27 04:37:48.070421 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=894000000,duration_sec=1557,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:48.071001 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:48.071414 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:772 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:50.068791 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:773 started Sep 27 04:37:50.071215 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=895000000,duration_sec=1559,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:50.072203 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:50.072552 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:773 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:52.069665 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:774 started Sep 27 04:37:52.072017 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230c3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=896000000,duration_sec=1561,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:52.072589 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:52.072971 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:774 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:54.070782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:775 started Sep 27 04:37:54.073101 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230c5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=897000000,duration_sec=1563,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:54.073693 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:54.074071 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:775 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:37:56.071507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:776 started Sep 27 04:37:56.073891 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=898000000,duration_sec=1565,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:56.074464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:56.074820 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:776 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:37:58.072782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:777 started Sep 27 04:37:58.075187 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=899000000,duration_sec=1567,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:37:58.075768 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:37:58.076117 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:777 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:00.073822 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:778 started Sep 27 04:38:00.076777 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230cb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=900000000,duration_sec=1569,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:00.077354 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:00.077707 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:778 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:02.074438 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:779 started Sep 27 04:38:02.076810 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=901000000,duration_sec=1571,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:02.077382 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:02.077732 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:779 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:04.074993 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:780 started Sep 27 04:38:04.077456 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=902000000,duration_sec=1573,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:04.078057 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:04.078406 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:780 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:06.076127 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:781 started Sep 27 04:38:06.078554 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=903000000,duration_sec=1575,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:06.079120 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:06.079469 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:781 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:08.077506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:782 started Sep 27 04:38:08.079900 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=904000000,duration_sec=1577,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:08.080463 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:08.080814 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:782 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:10.078327 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:783 started Sep 27 04:38:10.080660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=905000000,duration_sec=1579,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:10.081224 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:10.081575 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:783 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:12.079182 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:784 started Sep 27 04:38:12.081517 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=906000000,duration_sec=1581,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:12.082105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:12.082479 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:784 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:14.079704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:785 started Sep 27 04:38:14.082112 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=906000000,duration_sec=1583,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:14.082688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:14.083038 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:785 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:16.080363 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:786 started Sep 27 04:38:16.082791 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=907000000,duration_sec=1585,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:16.083361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:16.083715 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:786 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:18.080851 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:787 started Sep 27 04:38:18.083260 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230dd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=907000000,duration_sec=1587,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:18.083832 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:18.084187 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:787 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:20.081713 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:788 started Sep 27 04:38:20.084097 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230df,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=908000000,duration_sec=1589,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:20.084674 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:20.085030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:788 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:22.082594 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:789 started Sep 27 04:38:22.084979 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=909000000,duration_sec=1591,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:22.085551 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:22.085936 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:789 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:24.083881 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:790 started Sep 27 04:38:24.086239 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=910000000,duration_sec=1593,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:24.086813 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:24.087166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:790 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:26.084873 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:791 started Sep 27 04:38:26.087219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230e5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=911000000,duration_sec=1595,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:26.087795 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:26.088150 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:791 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:28.085801 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:792 started Sep 27 04:38:28.088181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=912000000,duration_sec=1597,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:28.088746 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:28.089093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:792 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:30.086453 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:793 started Sep 27 04:38:30.088803 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=913000000,duration_sec=1599,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:30.089377 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:30.089734 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:793 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:32.087792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:794 started Sep 27 04:38:32.090205 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=914000000,duration_sec=1601,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:32.090773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:32.091124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:794 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:34.088926 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:795 started Sep 27 04:38:34.091259 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=915000000,duration_sec=1603,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:34.091830 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:34.092180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:795 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:36.089847 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:796 started Sep 27 04:38:36.092723 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=916000000,duration_sec=1605,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:36.093285 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:36.093714 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:796 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:38.091629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:797 started Sep 27 04:38:38.094046 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=918000000,duration_sec=1607,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:38.094625 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:38.094987 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:797 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:40.092107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:798 started Sep 27 04:38:40.094500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=919000000,duration_sec=1609,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:40.095079 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:40.095434 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:798 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:42.092852 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:799 started Sep 27 04:38:42.095271 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=919000000,duration_sec=1611,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:42.095848 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:42.096211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:799 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:44.094240 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:800 started Sep 27 04:38:44.101084 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=921000000,duration_sec=1613,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:44.101673 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:44.102110 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:800 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:38:46.095317 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:801 started Sep 27 04:38:46.097756 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=922000000,duration_sec=1615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:46.098342 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:46.098695 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:801 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:48.096600 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:802 started Sep 27 04:38:48.099032 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=923000000,duration_sec=1617,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:48.099606 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:48.099961 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:802 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:50.097019 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:803 started Sep 27 04:38:50.099529 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=924000000,duration_sec=1619,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:50.100107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:50.100464 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:803 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:52.098249 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:804 started Sep 27 04:38:52.100522 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc230ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=925000000,duration_sec=1621,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:52.101089 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:52.101442 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:804 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:54.099170 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:805 started Sep 27 04:38:54.101473 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23101,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=926000000,duration_sec=1623,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:54.102072 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:54.102430 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:805 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:38:56.100014 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:806 started Sep 27 04:38:56.102556 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23103,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=927000000,duration_sec=1625,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:56.103139 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:56.103500 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:806 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:38:58.101647 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:807 started Sep 27 04:38:58.104040 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23105,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=928000000,duration_sec=1627,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:38:58.104608 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:38:58.104955 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:807 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:00.102572 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:808 started Sep 27 04:39:00.106027 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23107,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=929000000,duration_sec=1629,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:00.106615 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:00.106965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:808 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:39:02.103970 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:809 started Sep 27 04:39:02.106351 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23109,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=931000000,duration_sec=1631,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:02.107506 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:02.107856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:809 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:04.105172 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:810 started Sep 27 04:39:04.107526 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2310b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=932000000,duration_sec=1633,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:04.108092 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:04.108444 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:810 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:06.106443 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:811 started Sep 27 04:39:06.108819 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2310d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=933000000,duration_sec=1635,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:06.109392 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:06.109767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:811 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:08.107251 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:812 started Sep 27 04:39:08.109629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2310f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=934000000,duration_sec=1637,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:08.110235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:08.110585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:812 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:10.108282 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:813 started Sep 27 04:39:10.110666 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23111,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=935000000,duration_sec=1639,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:10.111235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:10.111585 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:813 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:12.108946 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:814 started Sep 27 04:39:12.111667 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23113,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=936000000,duration_sec=1641,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:12.112240 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:12.112591 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:814 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:14.109375 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:815 started Sep 27 04:39:14.111762 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23115,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=936000000,duration_sec=1643,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:14.112332 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:14.112681 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:815 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:16.110132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:816 started Sep 27 04:39:16.112772 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23117,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=937000000,duration_sec=1645,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:16.113348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:16.113704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:816 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:18.111269 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:817 started Sep 27 04:39:18.118576 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23119,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=943000000,duration_sec=1647,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:18.119145 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:18.119498 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:817 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 27 04:39:20.112448 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:818 started Sep 27 04:39:20.114763 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2311b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=939000000,duration_sec=1649,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:20.115337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:20.115694 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:818 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:22.113181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:819 started Sep 27 04:39:22.115706 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2311d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=940000000,duration_sec=1651,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:22.116286 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:22.116648 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:819 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:24.114371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:820 started Sep 27 04:39:24.116717 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2311f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=941000000,duration_sec=1653,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:24.117538 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:24.117917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:820 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:26.115622 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:821 started Sep 27 04:39:26.118275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23121,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=942000000,duration_sec=1655,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:26.118932 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:26.119289 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:821 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:28.116614 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:822 started Sep 27 04:39:28.119275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23123,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=943000000,duration_sec=1657,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:28.119840 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:28.120188 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:822 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:30.117925 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:823 started Sep 27 04:39:30.120611 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23125,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=945000000,duration_sec=1659,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:30.121665 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:30.122045 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:823 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:32.118569 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:824 started Sep 27 04:39:32.121013 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23127,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=945000000,duration_sec=1661,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:32.121586 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:32.121964 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:824 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:34.119597 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:825 started Sep 27 04:39:34.122850 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23129,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=947000000,duration_sec=1663,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:34.123489 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:34.123841 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:825 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:36.121125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:826 started Sep 27 04:39:36.123490 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2312b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=948000000,duration_sec=1665,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:36.124056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:36.124407 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:826 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:38.122048 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:827 started Sep 27 04:39:38.124429 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2312d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=949000000,duration_sec=1667,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:38.124997 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:38.125348 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:827 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:40.123378 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:828 started Sep 27 04:39:40.125715 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2312f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=950000000,duration_sec=1669,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:40.126313 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:40.126663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:828 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:42.124105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:829 started Sep 27 04:39:42.126496 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23131,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=951000000,duration_sec=1671,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:42.127068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:42.127422 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:829 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:44.124754 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:830 started Sep 27 04:39:44.127219 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23133,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=951000000,duration_sec=1673,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:44.127885 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:44.128124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:830 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:46.126181 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:831 started Sep 27 04:39:46.128553 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23135,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=953000000,duration_sec=1675,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:46.129125 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:46.129478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:831 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:48.127093 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:832 started Sep 27 04:39:48.130107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23137,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=954000000,duration_sec=1677,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:48.130704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:48.131030 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:832 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:50.128004 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:833 started Sep 27 04:39:50.130741 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23139,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=955000000,duration_sec=1679,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:50.131316 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:50.131671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:833 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:52.129276 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:834 started Sep 27 04:39:52.131560 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2313b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=956000000,duration_sec=1681,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:52.132124 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:52.132472 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:834 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:54.129887 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:835 started Sep 27 04:39:54.132283 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2313d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=956000000,duration_sec=1683,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:54.132852 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:54.133211 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:835 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:39:56.130688 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:836 started Sep 27 04:39:56.133102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2313f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=957000000,duration_sec=1685,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:56.133671 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:56.134048 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:836 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:39:58.131766 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:837 started Sep 27 04:39:58.134176 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23141,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=958000000,duration_sec=1687,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:39:58.135305 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:39:58.135686 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:837 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:00.133029 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:838 started Sep 27 04:40:00.136003 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23143,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=960000000,duration_sec=1689,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:00.136597 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:00.136947 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:838 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:02.134116 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:839 started Sep 27 04:40:02.137371 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23145,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=962000000,duration_sec=1691,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:02.137975 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:02.138356 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:839 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:04.135719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:840 started Sep 27 04:40:04.138921 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23147,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=963000000,duration_sec=1693,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:04.139493 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:04.139845 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:840 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:40:06.136126 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:841 started Sep 27 04:40:06.138823 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23149,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=963000000,duration_sec=1695,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:06.139778 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:06.140132 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:841 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:08.137203 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:842 started Sep 27 04:40:08.139931 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2314b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=964000000,duration_sec=1697,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:08.140502 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:08.140853 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:842 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:10.138629 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:843 started Sep 27 04:40:10.141705 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2314d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=965000000,duration_sec=1699,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:10.142307 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:10.142658 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:843 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:12.139677 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:844 started Sep 27 04:40:12.142837 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2314f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=966000000,duration_sec=1701,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:12.143411 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:12.143767 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:844 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:14.141068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:845 started Sep 27 04:40:14.143916 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23151,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=968000000,duration_sec=1703,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:14.144484 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:14.144837 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:845 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:16.141497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:846 started Sep 27 04:40:16.143824 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23153,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=968000000,duration_sec=1705,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:16.144785 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:16.145140 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:846 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:18.142913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:847 started Sep 27 04:40:18.145527 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23155,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=969000000,duration_sec=1707,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:18.146507 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:18.146858 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:847 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:20.143548 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:848 started Sep 27 04:40:20.145954 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23157,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=970000000,duration_sec=1709,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:20.146577 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:20.146938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:848 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:22.144171 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:849 started Sep 27 04:40:22.146792 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23159,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=971000000,duration_sec=1711,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:22.147361 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:22.147719 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:849 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:24.145682 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:850 started Sep 27 04:40:24.148129 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2315b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=972000000,duration_sec=1713,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:24.148692 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:24.149043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:850 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:26.148275 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:851 started Sep 27 04:40:26.156882 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2315d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=975000000,duration_sec=1715,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:26.158220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:26.158580 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:851 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 27 04:40:28.148913 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:852 started Sep 27 04:40:28.151309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2315f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=976000000,duration_sec=1717,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:28.151876 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:28.152227 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:852 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:40:30.149679 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:853 started Sep 27 04:40:30.152081 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23161,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=976000000,duration_sec=1719,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:30.152646 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:30.152995 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:853 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:32.150534 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:854 started Sep 27 04:40:32.153518 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23163,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=977000000,duration_sec=1721,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:32.154122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:32.154478 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:854 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:34.151405 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:855 started Sep 27 04:40:34.154107 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23165,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=978000000,duration_sec=1723,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:34.154685 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:34.155043 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:855 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:36.151920 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:856 started Sep 27 04:40:36.155056 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23167,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=979000000,duration_sec=1725,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:36.155655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:36.156040 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:856 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:38.152836 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:857 started Sep 27 04:40:38.155252 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23169,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=979000000,duration_sec=1727,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:38.156210 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:38.156567 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:857 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:40.153266 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:858 started Sep 27 04:40:40.155598 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2316b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=980000000,duration_sec=1729,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:40.156166 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:40.156514 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:858 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:40:42.154023 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:859 started Sep 27 04:40:42.156334 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2316d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=981000000,duration_sec=1731,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:42.156956 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:42.157313 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:859 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:40:44.155142 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:860 started Sep 27 04:40:44.157431 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2316f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=982000000,duration_sec=1733,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:44.158025 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:44.158374 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:860 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:40:46.156580 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:861 started Sep 27 04:40:46.158927 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23171,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=983000000,duration_sec=1735,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:46.159497 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:46.159846 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:861 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:40:48.157122 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:862 started Sep 27 04:40:48.159660 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23173,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=984000000,duration_sec=1737,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:48.160235 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:48.160728 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:862 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:50.157930 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:863 started Sep 27 04:40:50.160566 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23175,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=984000000,duration_sec=1739,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:50.161144 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:50.161501 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:863 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:52.159214 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:864 started Sep 27 04:40:52.161561 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23177,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=986000000,duration_sec=1741,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:52.162159 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:52.162511 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:864 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:54.159811 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:865 started Sep 27 04:40:54.162403 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23179,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=986000000,duration_sec=1743,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:54.163074 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:54.163432 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:865 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:40:56.160337 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:866 started Sep 27 04:40:56.162683 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2317b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=987000000,duration_sec=1745,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:56.163252 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:56.164180 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:866 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:40:58.161368 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:867 started Sep 27 04:40:58.163744 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2317d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=988000000,duration_sec=1747,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:40:58.164309 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:40:58.164655 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:867 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:41:00.162314 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:868 started Sep 27 04:41:00.169928 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2317f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=989000000,duration_sec=1749,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:00.170917 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:00.171452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:868 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 27 04:41:02.163037 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:869 started Sep 27 04:41:02.165854 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23181,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=990000000,duration_sec=1751,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:02.166428 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:02.166782 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:869 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:41:04.163965 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:870 started Sep 27 04:41:04.166288 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23183,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=991000000,duration_sec=1753,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:04.166855 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:04.167226 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:870 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:41:06.164735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:871 started Sep 27 04:41:06.167231 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23185,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=991000000,duration_sec=1755,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:06.167798 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:06.168146 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:871 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:41:08.165499 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:872 started Sep 27 04:41:08.167812 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23187,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=992000000,duration_sec=1757,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:08.168376 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:08.168726 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:872 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:41:10.165886 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:873 started Sep 27 04:41:10.168160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23189,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=992000000,duration_sec=1759,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:10.168723 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:10.169069 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:873 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:41:12.166856 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:874 started Sep 27 04:41:12.170549 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2318b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=994000000,duration_sec=1761,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:12.171158 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:12.171518 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:874 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 27 04:41:14.168258 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:875 started Sep 27 04:41:14.171207 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2318d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=995000000,duration_sec=1763,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:14.171773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:14.172121 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:875 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:41:16.169184 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:876 started Sep 27 04:41:16.171849 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2318f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=996000000,duration_sec=1765,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:16.172420 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:16.172773 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:876 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:41:18.170102 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:877 started Sep 27 04:41:18.172385 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23191,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=997000000,duration_sec=1767,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:18.173284 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:18.173632 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:877 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:41:20.171452 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:878 started Sep 27 04:41:20.173704 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23193,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=998000000,duration_sec=1769,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:20.174656 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:20.175014 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:878 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:41:22.172225 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:879 started Sep 27 04:41:22.175074 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23195,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=999000000,duration_sec=1771,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:22.175720 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:22.176123 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:879 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:41:24.172940 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:880 started Sep 27 04:41:24.175544 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23197,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=999000000,duration_sec=1773,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:24.176105 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:24.176455 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:880 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:41:26.174179 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:881 started Sep 27 04:41:26.176470 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc23199,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=1000000,duration_sec=1776,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:26.177313 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:26.177663 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:881 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 27 04:41:28.174960 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:882 started Sep 27 04:41:28.177278 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2319b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=2000000,duration_sec=1778,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:28.177868 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:28.178220 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:882 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:41:30.175735 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:883 started Sep 27 04:41:30.178160 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2319d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=2000000,duration_sec=1780,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:30.178722 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:30.179068 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:883 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 27 04:41:32.176908 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:884 started Sep 27 04:41:32.179343 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xbc2319f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=11020370386559921740,duration_nsec=3000000,duration_sec=1782,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107232) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 27 04:41:32.179938 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: DEBUG neutron.agent.linux.utils [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 108992. {{(pid=107232) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 27 04:41:32.180296 dv-cinder-859186-3-iscsi neutron-openvswitch-agent[107232]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-0fd7891e-a116-42cd-94a8-24caa2e07d13 None None] Agent rpc_loop - iteration:884 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004